Data Engineering - Tata Consultancy Services

Job Description

• Experience in Information Technology experience in Design, Development and Implementation of large scale and medium scale Data warehousing Applications using ETL tool IBM Infosphere Information server DataStage, SQL and Unix.

• End to End experience in all stages of Software Development Life Cycle including Data mapping, build, unit testing, system integration testing and performance tuning.

• 5-7 years With a broad portfolio of AWS infrastructure tools (EBS, S3, EC2, Elastic IP, Route 53, VPC) and with cloud infrastructure management and automation technologies.

• Working with basic structured, semi-structured, and unstructured data.

• Exposure to modern data/analytics architecture (Big Data, Cloud, etc.).

• Exposure to advanced analytics tools (Python, R, etc). Scripting (shell, python, ruby) skills for monitoring and automation.

• Strong understanding of the principles of Data Warehousing using fact tables, dimension tables and star/snowflake schema modelling. Worked extensively with Dimensional modelling, Data migration, Data cleansing, ETL Processes for data warehouses.

• Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes.

• Collaborating with data analysts, data architects, and software engineers to understand data requirements and deliver relevant data sets (e.g., for business intelligence).

• Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies

• Advanced knowledge and expertise in designing and developing ETL jobs using IBM Infosphere DataStage and sound experience in other IIS suite like Information Analyzer and basics on Quality Stage.

• Experience in IBM IIS DataStage Migration projects from planning to execution.

• Possess very strong expertise & knowledge in core banking and insurance domain applications. Solutions oriented professional with excellent skills in field of analysis, design, development, customizations, and implementation of software applications.

• Performance Tuning and Optimization of ETL jobs and SQL queries in ad-hoc and complex report environments.

• Extensive experience with ETL to load data from Flat Files, XML, Oracle and DB2 to ODBC databases & to perform various transformations using Filter, Transformer, Join, Lookup, Aggregator, Change Capture, Remove Duplicate, Shared container, Nested condition, Routines, Command activity stages to create robust mappings in the DataStage Designer.

• Familiar in using highly scalable parallel processing infrastructure using parallel jobs and multiple node configuration files.

• Experienced in scheduling Sequence and parallel jobs using DataStage Director, UNIX scripts and scheduling tools.

• Experience in troubleshooting of jobs and addressing production issues like data issues, ENV issues, performance tuning and enhancements.

• Extensive experience in design and development of Decision Support Systems (DSS).

• Extensive experience in Unit Testing, Functional Testing, System Testing, Integration Testing, Regression Testing, User Acceptance Testing (UAT) and Performance Testing.

• Worked with various databases like Oracle 10g/9i/8i, DB2, SQL Server, Teradata.

• Experience in writing PL/SQL stored procedures, functions, and packages.

• Proficient in writing Unix shell scripts and extensive experience working with unix operating systems.

• Provided value addition to that client by developing new solutions of process, which reduced manual intervention of users and gained significant performance improvement of existing process.