Senior Software Engineer - Data Infrastructure - Bloomberg
New York, NY
About the Job
Senior Software Engineer - Data Infrastructure
New York, NY
Posted Apr 25, 2024 - Requisition No. 124852
Bloomberg runs on data, it's our business and our product. The DataHub Engineering team provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse and real-time stream processing capabilities. The platform provides a single place in the company to discover, access, publish and subscribe to data.
The DataHub team introduced the abstraction of “dataset”, and invented a schema language to formally define all data at Bloomberg, complete with schema evolution, versioning, and true point in time semantics. We were the first team to introduce Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess and Spark for ETL, at Bloomberg for designing this new data intensive platform that is the hub of financial datasets. The DataHub’s DataOps and Infrastructure team designs, engineers and operates the infrastructure powering the DataHub platform.
Who are you?
We’re looking for innovative problem solvers who enjoy pursuing complex issues to their root cause. Curiosity, kindness, and an appetite to continually learn and share knowledge are key traits to being a member of DataHub. On a technical level, we’re looking for engineers who have proficiency and an interest in the following stack - Linux, Kubernetes, MySQL/RocksDB and infrastructure tools like OpenTofu, Ansible, OpenTelemetry.
We’ll trust you to:
+ Design, build and maintain large clusters of Distributed Datastores composed of engines like MySQL/MyRocks scaled using Vitess to Petabytes of data with millisecond response on billions of reads and writes across 100s of independent financial applications
+ Ensure platform reliability, observability and efficiency
+ Customize Kubernetes clusters
You’ll need to have:
+ 4+ years of software engineering experience
+ Experience with an object-oriented programming language (ideally Python or Golang)
+ Prior experience diagnosing failures in MySQL/MyRocks engines, replication protocols
+ Experience building reliable data infrastructure
+ A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience
We’d love to see
+ Any of your contributions in open source to Vitess, MySQL, RocksDB, MyRocks
+ Vitess Production Experience
+ Experience building custom resource controllers and Kubernetes operators.
About Us:
Meet the DataHub Engineering Team - https://www.techatbloomberg.com/blog/meet-the-team-datahub-engineering/
Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg provides reasonable adjustment/accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable adjustment/accommodation to apply for a job or to perform your job. Examples of reasonable adjustment/accommodation include but are not limited to making a change to the application process work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment. If you would prefer to discuss this confidentially, please email AMER_recruit@bloomberg.net (Americas), EMEA_recruit@bloomberg.net (Europe, the Middle East and Africa), or APAC_recruit@bloomberg.net (Asia-Pacific), based on the region you are submitting an application for.
Salary Range: 160,000 - 240,000 USD Annually + Benefits + Bonus
The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.
We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation [Exempt roles only], paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.
New York, NY
Posted Apr 25, 2024 - Requisition No. 124852
Bloomberg runs on data, it's our business and our product. The DataHub Engineering team provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse and real-time stream processing capabilities. The platform provides a single place in the company to discover, access, publish and subscribe to data.
The DataHub team introduced the abstraction of “dataset”, and invented a schema language to formally define all data at Bloomberg, complete with schema evolution, versioning, and true point in time semantics. We were the first team to introduce Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess and Spark for ETL, at Bloomberg for designing this new data intensive platform that is the hub of financial datasets. The DataHub’s DataOps and Infrastructure team designs, engineers and operates the infrastructure powering the DataHub platform.
Who are you?
We’re looking for innovative problem solvers who enjoy pursuing complex issues to their root cause. Curiosity, kindness, and an appetite to continually learn and share knowledge are key traits to being a member of DataHub. On a technical level, we’re looking for engineers who have proficiency and an interest in the following stack - Linux, Kubernetes, MySQL/RocksDB and infrastructure tools like OpenTofu, Ansible, OpenTelemetry.
We’ll trust you to:
+ Design, build and maintain large clusters of Distributed Datastores composed of engines like MySQL/MyRocks scaled using Vitess to Petabytes of data with millisecond response on billions of reads and writes across 100s of independent financial applications
+ Ensure platform reliability, observability and efficiency
+ Customize Kubernetes clusters
You’ll need to have:
+ 4+ years of software engineering experience
+ Experience with an object-oriented programming language (ideally Python or Golang)
+ Prior experience diagnosing failures in MySQL/MyRocks engines, replication protocols
+ Experience building reliable data infrastructure
+ A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience
We’d love to see
+ Any of your contributions in open source to Vitess, MySQL, RocksDB, MyRocks
+ Vitess Production Experience
+ Experience building custom resource controllers and Kubernetes operators.
About Us:
Meet the DataHub Engineering Team - https://www.techatbloomberg.com/blog/meet-the-team-datahub-engineering/
Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg provides reasonable adjustment/accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable adjustment/accommodation to apply for a job or to perform your job. Examples of reasonable adjustment/accommodation include but are not limited to making a change to the application process work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment. If you would prefer to discuss this confidentially, please email AMER_recruit@bloomberg.net (Americas), EMEA_recruit@bloomberg.net (Europe, the Middle East and Africa), or APAC_recruit@bloomberg.net (Asia-Pacific), based on the region you are submitting an application for.
Salary Range: 160,000 - 240,000 USD Annually + Benefits + Bonus
The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.
We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation [Exempt roles only], paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.
Source : Bloomberg