Data Architect - Diverse Linx
Chicago, IL
About the Job
Role: Data Architect
Position Type: Contract
Contract Duration: 6+ months with possibility of extension
Work Location: Chicago, IL ( Hybrid, onsite from day one)
Primary Skills: AWS, Python, Spark, KAFKA
Job Description:
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Position Type: Contract
Contract Duration: 6+ months with possibility of extension
Work Location: Chicago, IL ( Hybrid, onsite from day one)
Primary Skills: AWS, Python, Spark, KAFKA
Job Description:
- Strong expertise in Datawarehouse/data architecture domain.
- Strong experience with SQL and a good understanding of database management systems.
- Must have good understanding of AWS service integration and expert knowledge in Database & Big Data Analytics
- Design and optimize data models on AWS cloud using AWS data stores such as Redshift, RDS, S3
- Proficient working in Python Framework, S3, Athena
- Experience with other AWS services, such as S3, EC2, and EMR, and how they integrate with Redshift.
- Experience of designing batch and Realtime data ingestion on AWS for different sources.
- Hands on implementation knowledge of big data pipelines and building of Data lakes, Lambda and Kafka architecture
- Must be Techno-functional expert in end-to-end data pipeline in AWS including AWS Data Pipeline, AWS Step functions, AWS Lambda, AWS EMR and AWS Glue.
- End to end implementation experience in data analytics solutions (data ingestion, processing, provisioning and orchestration)
- Experience in Designing, developing and managing Kafka-based data pipelines.
- Design Domain Driven design based Avro Schemas for Kafka and help build Event driven framework standards.
- Ability to analyze any issues with the Kafka Avros and providing detailed solutions for them.
- Design message configuration and flows along with Recon with source.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx