Senior Azure Data engineers - Starcom consulting limited
Los Angeles, CA
About the Job
NEED A SUPER SENIOR CANDIDATE&
WITH ENERGY CLIENT EXPERIENCE IF POSSIBLE
&
Do not share if they do not have
Azure certifications (architect certification needed for this senior role)
Databricks certifications ( can have EITHER Databrick cert OR Oil and Gas Experience)& One is Required
Large scale data migrations
Azure synapse over many projects
Pyspark over many projects
For a senior role involving Azure and Databricks, especially with a focus on large-scale data migrations and working with Azure Synapse and PySpark, you'll want to pursue certifications and experiences that align with these requirements. Here's a breakdown of what you should consider:
### Azure Certifications
1. **Azure Solutions Architect Expert**& &
& & This is the most relevant certification for a senior role involving architectural design. It covers advanced topics such as infrastructure, security, and solutions design. The relevant exams are:
& & - **Exam AZ-305: Designing Microsoft Azure Infrastructure Solutions**&
2. **Azure Data Engineer Associate**& &
& & This certification could also be valuable given the focus on data migration and management. It covers data storage, data processing, and data security. The relevant exam is:
& & - **Exam DP-203: Data Engineering on Microsoft Azure**
### Databricks Certifications
1. **Databricks Certified Data Engineer Associate**& &
& & This certification demonstrates foundational knowledge in data engineering and is useful for working with Databricks.
2. **Databricks Certified Data Engineer Professional**& &
& & For a senior role, this certification would be more appropriate as it covers more advanced topics and practical skills.
3. **Databricks Certified Machine Learning Professional**& &
& & If your role involves machine learning, this certification can be beneficial.
& & **OR**
4. **Oil and Gas Industry Experience**& &
& & Since you can substitute Databricks certification with relevant industry experience, having a strong background in the oil and gas sector with data engineering or analytics roles would be valuable.
### Experience
1. **Large-Scale Data Migrations**& &
& & Demonstrating experience with large-scale data migrations is crucial. Be prepared to discuss specific projects where you’ve managed or contributed to substantial data migration efforts.
2. **Azure Synapse Analytics**& &
& & Experience with Azure Synapse is critical, especially if you've worked on multiple projects involving this technology. Highlight your familiarity with its integration with other Azure services and how you've leveraged it in past projects.
3. **PySpark**& &
& & Given the requirement to have experience with PySpark, ensure you have significant hands-on experience with it. Being able to discuss various projects where you’ve used PySpark for data processing, transformation, or analytics will be important.
### Summary
To be well-prepared for this senior role:
- **Achieve** the **Azure Solutions Architect Expert** certification and consider the **Azure Data Engineer Associate** certification.
- **Obtain** relevant Databricks certifications, ideally the **Certified Data Engineer Professional** or **Certified Machine Learning Professional**.
- **Showcase** your experience with large-scale data migrations, Azure Synapse, and PySpark through detailed project descriptions and results in your resume or during interviews.
Balancing these certifications and experiences will position you strongly for a senior role in this domain.
Source : Starcom consulting limited