Azure Data Engineer at Tata Consultancy Services

Role: Azure Data Engineer

Job Type: Full Time

Location: Seattle, WA (Onsite)

Job Description:

Must have skills:

• Proficient in Python and PySpark.
• Strong knowledge of SQL.
• Experience in building and optimizing complex data pipelines in Azure.
• Hand on experience on Azure Databricks.
• Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log analytics workspace, Service principal, managed identity, ACR and container instances etc.
• Should possesses knowledge about Azure networking services.
• Knowledge on Azure infrastructure creation using ARM templates.
• Well versed with GitLab and Azure DevOps.

Roles and Responsibilities:

• Build and maintain data pipelines
• Build and support required Azure Infrastructure - configurations, updates, etc.
• Support Data storage and processing framework
• Working with stakeholders including data, design, product
• Build processes that support data transformation, workload management, dependency and metadata