Databricks Engineers (Certification Program) - Turret Labs

Databricks Data Engineer

Turret Labs Raleigh-Durham-Chapel Hill Area (Remote)

Databricks Data Engineer - Opportunity to Join a Revolutionary Data and AI Leader!

Are you a data engineer looking to take your career to the next level? We're seeking a talented Databricks Data Engineer to join our innovative team and help shape the future of data processing and AI.

In this role, you'll be working with cutting-edge technologies like Apache Spark, Delta Lake, and MLflow, building and optimizing data pipelines that enable data-driven decision-making. You'll collaborate with data scientists, analysts, and engineers to design, develop, and maintain scalable, high-performance data processing systems on the Databricks Lakehouse platform.

Key Responsibilities:

- Design Databricks data pipelines and workflows using Databricks Lakehouse platform, Apache Spark, and Delta Lake

- Develop and maintain data ingestion, transformation, and loading processes for structured and unstructured data

- Collaborate with data scientists and analysts to understand data requirements and provide clean, reliable, and scalable data sets

- Implement best practices for data quality, data governance, and data security

- Optimize queries and data processing jobs for performance and efficiency

- Automate and monitor data pipelines, ensuring reliability and resilience

- Participate in code reviews and knowledge sharing within the team

Qualifications:

- 3+ years of experience as a Databricks Data Engineer, with a strong background in Spark and data pipeline development

- 3+ years of experience engineering Databricks solutions with a strong background in Spark and data pipeline development

- Proficiency in Python and SQL, with experience in PySpark and Spark SQL

- Familiarity with Databricks Lakehouse platform and Delta Lake is a strong plus

- Understanding of data engineering concepts, including batch and streaming data processing, data modeling, and ETL/ELT processes

- Experience with cloud platforms, preferably Databricks

- Ability to work collaboratively in a team environment and communicate technical concepts to non-technical stakeholders

- Bachelor's degree in Computer Science, Engineering, or a related quantitative field

--Databricks certifications desired

Join our team and be part of a revolution in data and AI! We offer a dynamic work environment, competitive compensation, and excellent growth opportunities. Apply now and let's build something amazing together!

NO THIRD PARTY SUBMISSIONS.

Must Be authorized to work in the US. Sponsorship not available.