Data Platform Engineer with Databricks - Indus Valley Consultants
Dayton, OH 45342
About the Job
Title: Data Platform Engineer with Databricks and Unity Catalog (implementation experience is must )
Duration: 10-12 months
Visa - USC/GC/H4-EAD
Location: Seattle WA
We will prefer local candidates or wo can relocate
We are fine with REMOTE candidate if he is a ROCK STAR
Imp note - Data Platform Engineer works on building tools and a platform to support other teams to run pipelines/jobs/reports etc.
Core skills needed -
- Data Platform Engineer with Databricks and Unity Catalog.
- Experience 10+ years
- Design and implement data architecture leveraging technologies such as Azure Databricks.
- Set up Unity Catalog,- 1 year exp is ok to have .
- Good to have Privacera, and Collibra.
- Develop, optimize, and manage data pipelines for ETL processes using azure Databricks, with a focus on data integrity and quality.
- Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices.
- Ensure data security and compliance with regulations using Databricks and Privacera's features.
- Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices.
- Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups.
- Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions.
Source : Indus Valley Consultants