Sr. Databricks Platform Engineer - Randstad USA
Minneapolis, MN 55401
About the Job
Our client is seeking a Contract to hire Sr. Databricks Platform Engineer. In either Denver, CO or Minneappolis, MN.
As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You'll handle administration, configuration, and optimization to support data analytics, machine learning, and data engineering activities. Collaborating with data engineers, data scientists, and stakeholders, you'll ensure the platform aligns with requirements while maintaining security and performance standards.
#LI-BW1
location: MINNEAPOLIS, Minnesota
job type: Contract
salary: $99 - 125 per hour
work hours: 8am to 5pm
education: No Degree Required
responsibilities:
- Configure, deploy and maintain Databricks clusters and workspaces.
- Use Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources. Ensure consistency and repeatability by treating infrastructure as code
- Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Manage platform feature and software releases and updates.
- Provide technical support to Databricks users, including troubleshooting and issue resolution.
- Conduct training sessions to educate users on platform best practices and capabilities.
- Optimize cluster configurations for performance and cost-effectiveness.
- Monitor and manage auto-scaling to ensure resources are allocated efficiently.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Stay up-to-date with security best practices and compliance requirements.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
- Monitor and manage platform costs, including optimizing resource utilization to control expenses.
- Maintain detailed documentation of configurations, procedures, and best practices.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions
qualifications:
- Experience level: Manager
- Education: No Degree Required
skills:
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
Applications accepted on ongoing basis until filled.