Senior Big Data ETL Developer- Hartford CT - Georgia IT Inc.
Hartford, CT
About the Job
Senior Big Data ETL Developer
Location: Hartford CT
Duration: 6+ months Contract
Rate: DOE
U.S Citizen, Green Cards and EAD preferred. No Sponsorship available for this contract to hire job
Job Description:
successful developer will be able to act as a subject matter expert to analyze, design, develop, implement and support data quality and ETL solutions in a Big Data environment. Writes ETL (Extract / Transform / Load) processes, monitors and maintains an existing pipeline of raw data files being integrated into analytic systems. Uses knowledge in Hadoop architecture, HDFS commands and experience designing & optimizing queries to build data pipelines. Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards. Analyzes current information technology environments to identify and assess critical capabilities and recommend solutions. Experiments with available tools and advises on new tools to determine optimal solution given the requirements dictated by the model/use case. Duties include but are not limited to acquiring and interpreting business requirements, creating technical solutions to ingest disparate data into an established database system, perform source data analysis and data profiling, and work with the business to develop high-quality, efficient translation rules. Must have a strong attention to detail, the ability to work independently with limited supervision.
Background/Experience desired:
3 or more years of progressively complex related experience. Has strong knowledge of large-scale applications and building high volume data pipelines. Experience building data transformation and processing solutions. Knowledge in Hadoop architecture, HDFS commands and experience designing & optimizing queries against data in the HDFS environment. Knowledge in Java
Location: Hartford CT
Duration: 6+ months Contract
Rate: DOE
U.S Citizen, Green Cards and EAD preferred. No Sponsorship available for this contract to hire job
Job Description:
- This position is looking for a Hadoop Developer in a Big data Environment.
- 3-5 years' experience.
- Programmer with good communication skills.
- Ability to work independently with a business team.
- This person will be working with the Data Exchange for Net Lab functions. This department collects lab test results from their different lab partners including:
- Quest
- CVS
- Walgreens
- Experience in a Big Data Environment
- Hadoop
- HIVE
- SQL
- Spark
- Python
successful developer will be able to act as a subject matter expert to analyze, design, develop, implement and support data quality and ETL solutions in a Big Data environment. Writes ETL (Extract / Transform / Load) processes, monitors and maintains an existing pipeline of raw data files being integrated into analytic systems. Uses knowledge in Hadoop architecture, HDFS commands and experience designing & optimizing queries to build data pipelines. Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards. Analyzes current information technology environments to identify and assess critical capabilities and recommend solutions. Experiments with available tools and advises on new tools to determine optimal solution given the requirements dictated by the model/use case. Duties include but are not limited to acquiring and interpreting business requirements, creating technical solutions to ingest disparate data into an established database system, perform source data analysis and data profiling, and work with the business to develop high-quality, efficient translation rules. Must have a strong attention to detail, the ability to work independently with limited supervision.
Background/Experience desired:
3 or more years of progressively complex related experience. Has strong knowledge of large-scale applications and building high volume data pipelines. Experience building data transformation and processing solutions. Knowledge in Hadoop architecture, HDFS commands and experience designing & optimizing queries against data in the HDFS environment. Knowledge in Java
Source : Georgia IT Inc.