Senior Azure Data Engineer (Manager) - Remote/White Plains, NY - Stott and May

Senior Azure Data Engineer (Manager) – Remote/White Plains, NY

Skills

– Data Engineering, Senior Data Engineer, Hands On, Azure, Azure Databricks, Azure Data Factory, Data Lakes, Management, Data Warehouse, Project Delivery, Communication Skills

My client who is a leading Global brand within the CPG industry is currently looking to on board a Senior Azure Data Engineer. The ideal individual will have a proven and strong hands on background within Azure, Azure Databricks, Azure Data Factory and building the data lakes themselves.

This is a Full Time position which will see individuals working remotely 2-3 days per week, with the remaining 2-3 days on-site at my client’s offices in White Plains, NY.

The Role/Core Responsibilities:

• As the Data Engineer, you will be directly responsible for availability, quality, and reliability of data to meet business data needs across the organization.
• The primary focus of this role will revolve around data warehouse maintenance in MS Azure.
• As a Senior Azure data engineer, you will be in charge of designing, building, and maintaining the data infrastructure to make sure that the internal and external systems are integrated seamlessly, and the data is flowing smoothly.
• Work closely with the business to deliver complex data integrations and projects to meet my client’s needs from a data perspective.
• Design, build and maintain data pipelines using tools such as Azure Data Factory, Databricks, Azure Synapse, SQL, Python.
• Oversee the creation of data pipelines and data marts in real time, near real time and batch processing.
• Ensure accurate and efficient integration of large variety (structured, semi-structured and unstructured) of data from various sources.
• Own and manage all data warehouse deliverables, such as data models, ETL/ELT processes, and data quality assessments.
• Ensure consistent adherence to data warehouse architecture standards through governance, best practices, and automation.
• Manage the day-to-day operations of the Azure data, Power BI and UC4 platforms
• Monitor, audit, and measure data warehouse performance and recommend improvements.
• Manage data lake environment including blob storage.
• Guide development and implementation of procedures for maintenance and monitoring of data warehouse and related systems.
• Ensure the availability, performance, and scalability of data warehouse platform, including data pipelines, security controls, administration tools and warehouse database.

The Candidate:

• 8+ years of experience in data warehousing, data modelling, and data transformation.
• Proven hands on and extensive experience with Azure Data Factory (ADF), Azure Databricks and Azure Data Lake Storage (ADLS).
• Strong grasp of data ingestion, transformation, and delivery (ETL/ELT) processes.
• Expert knowledge of SQL Server environments for designing and developing databases.
• Highly proficient in PySpark and SQL.
• Experience working with Power BI dataflows and job scheduling platform UC4 is beneficial to have
• Extensive experience working with complex systems to retrieve, analyze and synthesize data.
• Proven ability to communicate complex technical processes and data concepts in an understandable manner to business stakeholders.
• Prior experience implementing end-to-end data pipelines for large datasets using cloud and on-premise stack.

Salary – $150k-$170k Per Annum + Bonus (20%) + Benefits

Please send resumes directly to patrick.hindmarsh@stottandmay.com and we can look to run through the specifics.

I look forward to hearing from you.

Skills

– Data Engineering, Senior Data Engineer, Hands On, Azure, Azure Databricks, Azure Data Factory, Data Lakes, Management, Project Delivery, Communication Skills

Senior Azure Data Engineer (Manager) – Remote/White Plains, NY