Data Engineer at The Jupiter Group
Houston, TX 77002
About the Job
We're working with a Fortune 500 oil and gas client in Houston that is looking to expand their existing Data Engineering team. We've been in discussion with the hiring manager and he's going to be targeting strong python programmers with OOP expertise, not scripters. This role will initially focus on the front end and API work while collaborating with the Data Science team.
No 3rd party. US Citizen or Green Card holders only.
No 3rd party. US Citizen or Green Card holders only.
Responsibilities include:
- Design and implement reliable data pipelines to integrate disparate data sources into a single
- Design and implement data quality pipelines to ensure data correctness and building trusted datasets
- Design and implement data solutions which accurately reflects business operations
- Assist with data platform performance tuning and physical data model support including partitioning and compaction
- Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives
The successful candidate will meet the following qualifications:
- 5+ years of experience as a Data Engineer designing and maintaining web applications using Python, JavaScript, HTML, CSS, and other front end technologies
- 5+ years of programming experience in Python, ANSI SQL, PL/SQL, and T-SQL
- Experience in various data integration patterns including ETL, ELT, Pub/Sub, and Change Data Capture
- Experience with common Python Data Engineering packages including pandas, Numpy, PyArrow Pytest, Scikit-Learn, and Boto3
- Experience in software development practices such as Design Principles and Patterns, Testing, Refactoring, CI/CD, and version control
- Knowledgeable of modern data platform technologies including Apache Airflow, Kubernetes, and S3 Object Storage
Salary
LTI, bonus, 6% 401K, and more