Senior Data Engineer - Britech Group, Inc
Carlsbad, CA
About the Job
As a Senior Data Engineer, your role is pivotal in harnessing data and technology to propel our organization's business growth, enhance customer engagement, and support data-centric decision-making. You will be instrumental in developing, managing, and enhancing data pipelines and deploying machine learning models for predictive analytics that serve a broad range of data consumers, including business and data analysts, data scientists, and other stakeholders requiring refined data for diverse enterprise analytics applications.
Key Responsibilities:
- Architect, construct, and sustain our data infrastructure utilizing tools such as Snowflake, Azure, and Databricks.
- Design, implement, and oversee ELT/ETL processes using Python, SQL, and Spark to maintain data precision, completeness, and uniformity.
- Develop and maintain machine learning models for applications like predictive analytics, recommendation engines, and anomaly detection.
- Work collaboratively with various teams to interpret business needs and devise data-driven solutions.
- Adhere to data privacy standards and implement industry best practices.
- Manage and optimize DevOps strategies to automate the deployment and testing of data workflows.
- Keep abreast of emerging data technologies and methodologies, advocating for their adoption where beneficial.
- Operate within an Agile framework to ensure timely, budget-conscious delivery of high-caliber solutions.
Technical Competencies:
- Proficient in constructing data pipelines using Snowflake.
- Familiar with the MarTech landscape.
- Capable of handling complex data sets from diverse sources.
- Proficient in scripting languages such as Python and R.
- Experienced in developing and deploying machine learning models with TensorFlow, PyTorch, or scikit-learn.
- Well-versed in DevOps practices, cloud-native platforms (e.g., Kubernetes, serverless technologies), and infrastructure as code (IaC) tools like Terraform.
- Strong communication skills, both written and verbal.
- Driven, self-motivated, and committed to achieving results.
Education and Experience Requirements:
- Bachelor’s degree in Computer Science, Mathematics, Statistics, or a related field.
- At least eight years of relevant professional experience.
- Minimum of five years' experience working with cloud platforms, Snowflake, Azure, and data visualization tools.
- Proficiency in data integration tools like Spark/Databricks and Linux/Unix shell scripting.
Source : Britech Group, Inc