Data Engineer (AWS Cloud) - POWERHOUSE INSTITUTE INC

Data Engineer (AWS Cloud)

NOTE:   This is a full-time employment opportunity.  The candidate MUST be a U.S. Citizen OR Green Card (U.S. Permanent Resident) and complete/pass/hold a Public Trust background investigation.This is a remote opportunity. 

Daily Responsibilities

• Play a critical role in ingesting, transforming, and managing data using AWS Cloud Services and Python Programming.  Will also have to work directly with other senior data engineers and product owners to deliver data products in a collaborative and agile environment. They will also need to be able to integrate code into a cloud production environment.
• Work with on-prem database and warehouse solutions such as Oracle or SQL Server or Cloud based solutions.
• Collaborate on data engineering coding principles, standards, designs, frameworks, and chaos testing.
• Develop data engineering solutions using Python and/or Java.
• Seek to continuously develop deep AWS engineering skills that optimize code quality and performance.
• Build data pipelines and other custom automated solutions to speed the ingestion, analysis, and visualization of large volumes of data.
• Develop data transformation pipelines to clean, enrich, and structure the ingested data for storage in AWS Redshift platform services and storage services. 
• Integrate data from disparate sources to enable seamless data access and analysis within the data management environment.
• Design and maintain data models within and implement data quality checks and validation processes to ensure data accuracy and integrity.
• Ensure data security and compliance with government regulations and industry standards.
• Optimize data pipelines and queries for efficient data processing and retrieval.
• Work closely with business analysts, data scientists, and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
• Participate in Agile development Sprints (2-week cycles) including design, development, unit testing and peer review. 
• Provide domain expertise for user stories, including descriptions, acceptance criteria and pointing.
• Prepare comprehensive documentation for data pipelines, data models, and data processes.

Requirements

• Must be a U.S. Citizen or Green Card (U.S. Permanent Resident) (As mandated by our government client).
• Must complete/pass/hold a Public Trust background investigation.
• 7 years of experience in data engineering, with a focus on data integration, data transformation, and data warehousing.
• 7 years Cloud Development (AWS Cloud) for data processing including experience doing ETL processes.
• 7 years in a technical management capacity for a large enterprise with a high performing technical team.
• 7 years’ experience with AWS Glue, AWS Data Brew, NoSQL server, SQL Server query experience, AWS Informatica for Relational Database Service (RDS) and the Cloud.
• 7 years of experience in designing and developing Data Pipelines for Data Ingestion or Transformation using AWS technologies.
• Python programming experience.
• Familiarity with data integration patterns and best practices.
• Experience with data cleansing, profiling, and domain-specific data quality assessment.
• Experience working in an Agile development environment, with an understanding of Agile principles and practices. 
• Experience working in code repositories (i.e., GitHub) to support CI/CD.
• Must be able to collaborate with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS Glue and/or Informatica for big data technologies.  
• Excellent verbal and written communication skills for expressing technical software requirements and designs.
• BS/BA degree in Computer Science, Information Sciences, or related IT discipline.  Additional five (5) years of related professional experience can be substituted for a BS/BA degree.

Preferred Experience (a PLUS)          

• Strong understanding of AWS Data Lake, data warehouse, and experience with data modeling.  
• Familiarity with big data technologies and distributed computing frameworks (e.g., Hadoop, Spark).
• Relevant certifications in AWS data services or data engineering.
• Experience with data visualization tools such as Power BI or Tableau.
• Understanding of data governance principles and their application in data engineering projects.

Powerhouse Institute, Inc. is a Management Consulting and Technology Solutions company. Our people bring a great mix of expertise and commitment to deliver solutions and solve problems.

Our services include Management Consulting, Enterprise Architecture, Solutions Architecture, Cloud Solutions, Cloud Migration, Data Analytics, Cyber Security, IT Services, and Training.

Powerhouse Institute, Inc. is an Equal Opportunity Employer. Powerhouse Institute, Inc. does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

Powered by JazzHR