Lead Data Engineer at iSphere
Houston, TX 77046
About the Job
iSphere is actively seeking a dynamic Lead Data Engineer in Houston for a flex opportunity, specializing in the Power & Gas Commodity markets. This hands-on role involves developing full-stack applications to facilitate Front Office Trading activities, emphasizing the creation of enterprise-wide solutions. As a tech enthusiast, you will collaborate with end-users to analyze requirements, design innovative solutions, and deliver substantial business value.
Key Responsibilities:
- Develop and maintain the Front Office Data warehouse on Amazon Web Services (AWS).
- Design and implement scalable data pipelines to meet organizational data needs.
- Lead a team of data engineers in creating, testing, and deploying data pipelines and ETL processes.
- Collaborate with various teams to understand data requirements and provide effective solutions.
- Establish and enforce best practices for data engineering processes.
- Evaluate and implement new technologies to enhance data pipeline efficiency.
- Monitor and optimize data system performance for reliability, scalability, and cost-effectiveness.
- Provide technical leadership and mentorship to junior team members.
- Troubleshoot and resolve issues related to data pipeline failures and performance bottlenecks.
- Work closely with DevOps and infrastructure teams to manage data systems in production environments.
- Stay informed about industry trends and incorporate emerging technologies to improve existing systems.
Skills and Experience:
- Bachelor's or Master's degree in Computer Science or equivalent experience.
- 10+ years of experience in designing, building, and deploying large-scale data pipelines and ETL processes.
- Background in Power & Gas Commodities is advantageous.
- Proficient in programming languages like Python.
- Expertise in SQL Server, Database Administration, data modeling, and database design.
- Familiarity with modern data warehouse platforms such as Snowflake and Data Bricks.
- Experience with AWS cloud platform.
- Knowledge of containerization technologies like Docker and orchestration tools such as Kubernetes.
- Previous leadership or mentoring experience is preferred.
- Relevant certifications like AWS Certification are a bonus.
If you are a seasoned Lead Data Engineer with a passion for technology and a track record of delivering impactful solutions, we encourage you to apply and join our innovative team at iSphere.
Key Responsibilities:
- Develop and maintain the Front Office Data warehouse on Amazon Web Services (AWS).
- Design and implement scalable data pipelines to meet organizational data needs.
- Lead a team of data engineers in creating, testing, and deploying data pipelines and ETL processes.
- Collaborate with various teams to understand data requirements and provide effective solutions.
- Establish and enforce best practices for data engineering processes.
- Evaluate and implement new technologies to enhance data pipeline efficiency.
- Monitor and optimize data system performance for reliability, scalability, and cost-effectiveness.
- Provide technical leadership and mentorship to junior team members.
- Troubleshoot and resolve issues related to data pipeline failures and performance bottlenecks.
- Work closely with DevOps and infrastructure teams to manage data systems in production environments.
- Stay informed about industry trends and incorporate emerging technologies to improve existing systems.
Skills and Experience:
- Bachelor's or Master's degree in Computer Science or equivalent experience.
- 10+ years of experience in designing, building, and deploying large-scale data pipelines and ETL processes.
- Background in Power & Gas Commodities is advantageous.
- Proficient in programming languages like Python.
- Expertise in SQL Server, Database Administration, data modeling, and database design.
- Familiarity with modern data warehouse platforms such as Snowflake and Data Bricks.
- Experience with AWS cloud platform.
- Knowledge of containerization technologies like Docker and orchestration tools such as Kubernetes.
- Previous leadership or mentoring experience is preferred.
- Relevant certifications like AWS Certification are a bonus.
If you are a seasoned Lead Data Engineer with a passion for technology and a track record of delivering impactful solutions, we encourage you to apply and join our innovative team at iSphere.