ETL Data Engineer - Diverse Linx
Chicago, IL
About the Job
Role: ETL Data Engineer (Infosphere DataStage)
Location: Chicago, IL- Only Local
Experience: 8+ Year
Duration: 12+ Months
Role Description:
- A ETL Data Engineer will function as a mid-level technical resource to participate as a member of a development team building, integrating, and maintaining data solutions for Wealth various operational and reporting systems.
- Data engineers will provide deep hands-on expertise in modern data architecture and implementation experience in delivering innovative Data products to leverage data as a strategic asset.
- They will be part of a highly dynamic team on a multiyear journey to build real time Operational and Analytic data repositories.
- The ETL Developer will be involved in the design, build, unit testing, and deployment of multiple types of ETL approaches spanning traditional ETL (e.g. IBM DataStage) and evolving toward newer technologies.
- The developer should expect to pull multiple formats of source data including XML, web services, delimited flat files, and other sources.
Responsibilities
- Responsible for translating functional ETL requirements into a technical design document, coding/building programs to pull data from the source into staging tables, from staging tables into conformance tables using Change Data Capture methodologies, and into dimensional data marts for reporting or outbound interfaces to other consuming systems.
- Designs, develops, enhances, debugs, and implements software. Troubleshoots production problems related to software applications.
- Addresses problems of systems integration, compatibility, and multiple platforms.
- Consults with project teams and end users to identify application requirements.
- Performs feasibility analysis on potential future projects to management.
- Resolves problems with software and responds to suggestions for improvements and enhancements.
- Ensure all changes are properly documented, planned, tested, and approved prior to being moved into production
- Must be able to code, debug and test IBM Data stage jobs including complex SQL statements.
- Ensure work meets functionality and quality expectations within given timelines
Qualifications? Strong Knowledge of:
- Data Warehouse, Data Lake , Data Mart and ODS Architecture
- Understanding of Relational and Dimensional Data modeling
- Ability to design , build and tune scalable data pipelines with appropriate ABC framework is a must have
- Data profiling & DQ frameworks
- Exposure to streaming frameworks and Message oriented middleware like Kafka and Solace
- The candidate needs to be a self-starter, critical thinker and creative problem solver and needs to have past experience in effectively collaborating with distributed team across different time zones
- Effective written and verbal communication skills and intellectual understanding of the spectrum of analytic workflows to turn actionable data sets to value driven insights will make the candidate standout
- IBM Datastage Experience. Strong SQL skills.
- Experience in UNIX scripting, FTP and basic network principles
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx