Quality Data Engineer - Federal Reserve Bank (FRB)
New York, NY 10001
About the Job
Company
Federal Reserve Bank of New YorkWorking at the Federal Reserve Bank of New York positions you at the center of the financial world with a unique perspective on national and international markets and economies. You will work in an environment with a diverse group of experienced professionals to foster and support the safety, soundness, and vitality of our economic and financial systems.
The Bank believes in work flexibility to balance the demands of work and life while also connecting and collaborating with our colleagues in person. Employees can expect to be in the office a couple of days per week as needed for meetings and team collaboration and should live within a commutable distance.
What we do:
As a member of Markets Technology Delivery supporting the Markets business domain, the area responsible for the Auctions, Trading Desks and Operations, you will contribute to financial applications and tools in support of Markets’ auctions, trading, operations planning, and execution. You will be part of an agile squad that requires close collaboration with other members of the technology team, business users, and other development squad members to create a quick feedback loop for Quality through Test Automation and Continuous Testing.
Your role as a Quality Data Engineer:
The Quality Engineer within the Markets Technology Function is responsible for overall quality assurance and testing of IT solutions. Participates in every phase of the development process in an agile team to ensure that the design and software adhere to business needs. In this role you will be able responsible for executing Data Engineering Testing practices within a product team that is responsible for data management solutions.
- Develop solutions to automate testing of data engineering and integration pipelines in an AWS ecosystem with Databricks, Trino and Delta Lake as the underlying platforms.
- Design and develop automated test scripts that ensure data products meet their functional and non-functional requirements.
- Validate data migration and ETL processes as we migrate pipelines to cloud data platforms
- Work closely with Sr. QA Engineers and key SMEs such as the Product Owner, Solution Architect, and/or Scrum Master to plan the test strategy.
- Support the DevSecOps vision by designing automation to integrate with build pipelines, and other automated unit, integration, and system tests.
- Promote innovation and evolution of quality engineering techniques, test automation technologies and ensure pervasive quality in product development.
- Promote agility and demonstrate cross functional skills by taking on development and other non-QE related tasks.
What we are looking for:
- Bachelor's or master’s degree in computer science, Information Technology, or a related field.
- Strong technical proficiency to contribute to the quality engineering and data engineering tasks in AWS and Databricks ecosystem
- Strong in building test automation and working with automated frameworks and tools
- Proven ability to code in Python and SQL with a working knowledge of Spark and PySpark
- Proven ability in Gitlab with CI/CD.
- Proven ability in Python test automation with knowledge of frameworks.
- Proven ability as an AWS Cloud engineer with experience in products such as S3, RDS, Lambda, SQS, SNS, MSK
Salary Range: $116500 - $200400 / year
We believe in transparency at the NY Fed. This salary range reflects a variety of skills and experiences candidates may bring to the job. We pay individuals along this range based on their unique backgrounds. Whether you’re stretching into the job or are a more seasoned candidate, we aim to pay competitively for your contributions.
Our Touchstone Behaviors—Communicate Authentically, Collaborate Inclusively, Drive Progress, Develop Others, and Take Ownership—help shape the culture of the Bank. They also provide a shared language for how we work together and achieve success, and they set clear expectations for leading with impact at every stage of your career with us. Learn more.
Benefits:
Our organization offers benefits that are the best fit for you at every stage of your career:
Fully paid Pension plan and 401k with Generous Match
Comprehensive Insurance Plans (Medical, Dental and Vision including Flexible Spending Accounts and HSA)
Subsidized Public Transportation Program
Tuition Assistance Program
Onsite Fitness & Wellness Center
And more
The New York Fed expects its employees to perform their duties with honesty, integrity, and impartiality, and without improper preferential treatment of any person. Learn more about our code of conduct and conflicts of interest rules.
The Federal Reserve Bank of New York is committed to a diverse workforce and to providing equal employment opportunity to all persons without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, age, genetic information, disability, pregnancy, or military service.
We value accessibility for all candidates and are happy to provide an accommodation or assistance. Please email us at ny.leaves@ny.frb.organd we’ll be glad to help.Please note, this is a dedicated e-mail box designed exclusively to assist applications with accommodation requests in relation to our recruiting process. All other inquires including the status of applications will not receive a response from this e-mail box.
This is not necessarily an exhaustive list of all responsibilities, duties, performance standards or requirements, efforts, skills or working conditions associated with the job. While this is intended to be an accurate reflection of the current job, management reserves the right to revise the job or to require that other or different tasks be performed when circumstances change.
This position requires access to confidential supervisory information (CSI) and/or Federal Open Market Committee (FOMC) information. Access to CSI and FOMC information is limited to U.S. citizens, lawful permanent residents, individuals who meet the definition of “protected individual” under 8 U.S.C. § 1324b(a)(3), and certain other nonimmigrants. All non-U.S. citizens authorized to access CSI and/or FOMC information must sign a declaration of intent to expeditiously become a lawful permanent resident and thereafter a U.S. citizen when eligible.
Full Time / Part Time
Full timeRegular / Temporary
RegularJob Exempt (Yes / No)
YesJob Category
Information TechnologyWork Shift
First (United States of America)The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.