Databricks Platform Engineer - Judge Group
Denver, CO
About the Job
Location: Denver, CO
Salary: $65.00 USD Hourly - $75.00 USD Hourly
Description: Our client is currently seeking a Databricks Platform Engineer
Contact: kgregor@judge.com
Salary: $65.00 USD Hourly - $75.00 USD Hourly
Description: Our client is currently seeking a Databricks Platform Engineer
This role is hybrid and can sit in Denver, CO or Minneapolis, MN
Responsibilities:
Qualifications:
Responsibilities:
- Configure, deploy and maintain Databricks clusters and workspaces.
- Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources.
- Ensure consistency and repeatability by treating infrastructure as code, monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Manage platform feature and software releases and updates.
- Provide technical support to Databricks users, including troubleshooting and issue resolution.
- Conduct training sessions to educate users on platform best practices and capabilities.
- Optimize cluster configurations for performance and cost-effectiveness.
- Monitor and manage auto-scaling to ensure resources are allocated efficiently.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Stay up-to-date with security best practices and compliance requirements.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
- Monitor and manage platform costs, including optimizing resource utilization to control expenses.
- Maintain detailed documentation of configurations, procedures, and best practices.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions.
Qualifications:
- Bachelor's degree in a relevant field (computer science, data engineering, etc.)
- 7+ years of related professional experience.
- 3 years’ experience with Databricks Lakehouse Platform Architecture on AWS
- Strong knowledge of IaC via Terraform HCL, SQL, Python, Apache Spark, Gitlab CI/CD pipelines, MLOps Proficiency in AWS cloud platforms
- Experience in Utility and Energy related business is a plus.
Contact: kgregor@judge.com
This job and many more are available through The Judge Group. Find us on the web at www.judge.com
Source : Judge Group