Azure Data Engineer at Tata Consultancy Services
Seattle, WA
About the Job
Job Title: Azure Data Engineer
Job Type: Full Time
Location: Seattle, WA (Onsite)
Job Description
Must Have:
- Proficient in Python and PySpark.
- Strong knowledge of SQL.
- Experience in building and optimizing complex data pipelines in Azure.
- Hand on experience on Azure Databricks.
- Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log analytics workspace, Service principal, managed identity, ACR and container instances etc.
- Should possesses knowledge about Azure networking services.
- Knowledge on Azure infrastructure creation using ARM templates.
- Well versed with GitLab and Azure DevOps.
Roles & Responsibilities
- Build and maintain data pipelines
- Build and support required Azure Infrastructure - configurations, updates, etc.
- Support Data storage and processing framework
- Working with stakeholders including data, design, product
- Build processes that support data transformation, workload management, dependency and metadata