Data Engineer - Atmospheric G2

Company Overview:

For over twenty years, Atmospheric G2 has provided our customers market-leading weather intelligence software that enables them to confidently assess the impacts of weather on their markets. Our flagship product is up on monitors throughout the trading day across most trade floors in North America and Europe. AG2 forecasts have been proven, via various third-party studies, to have the best accuracy in the world, exceeding the US National Weather Service and other weather vendors. At AG2, we understand that the strength of our offerings depends on the talent of our team, and we are seeking skilled Data Engineers to help us maintain our position as an industry leader.

Job Description:

We are looking for an experienced Data Engineer to join our team and contribute to the development of data processing and transformation pipelines. The ideal candidate will have expertise in building Python ETL processes, leveraging AWS Step Functions and Lambda, and working with relational databases such as MySQL (or equivalents). Familiarity with weather data formats, including GRIB, NetCDF, and Zarr, is a bonus and will help in supporting AG2’s core mission of providing high-quality, accurate weather intelligence.

Key Responsibilities:

• Develop, maintain, and optimize ETL pipelines for processing and transforming data, primarily using Python with AWS Step Functions and Lambda.
• Manage, monitor, and scale data workflows to ensure reliability, accuracy, and timeliness.
• Design and implement data models and database structures, primarily in MySQL or equivalent systems.
• Collaborate closely with cross-functional teams to understand data requirements and deliver solutions that support business goals.
• Enhance data pipelines to integrate with weather-specific formats (GRIB, NetCDF, Zarr) as applicable.
• Participate in code reviews and provide constructive feedback to peers, promoting a high-quality codebase.
• Contribute to best practices in data engineering, including data quality and observability.
• Stay informed on emerging data engineering technologies, particularly those in AWS and weather data handling.

Requirements:

• 5+ years of experience in data engineering, with a strong focus on Python-based ETL processes.
• Proficiency with AWS services, including Step Functions, Lambda, and other data-related services.
• Strong experience with MySQL or equivalent relational database systems.
• Experience working with weather data formats (GRIB, NetCDF, Zarr) is a plus.
• Strong problem-solving skills with attention to data accuracy and quality.
• Familiarity with version control systems, particularly Git.
• Excellent communication and collaboration skills to work effectively within cross-functional teams.

What We Offer:

• A competitive salary and comprehensive benefits package.
• A well-established company with a start-up mindset, fostering innovation and agility.
• A collaborative work environment that values professional growth and contribution.
• Flexibility with a hybrid work model to support work-life balance.

Join our team to make an impact in the world of weather intelligence, leveraging your data engineering expertise to drive informed decisions across global markets.