Data Quality Engineer - Leadstack Inc

LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world.

Title : Data Quality Engineer
Location : Blue Ash, Ohio (remote work)
Duration : 6+ months contract

Job Description:
We are seeking a skilled Data Quality Engineer to join our team and play a critical role in ensuring the reliability, accuracy, and consistency of data within our warehouse and manufacturing data platform in the *** supply chain space.
While the title may suggest a focus on quality assurance, this role requires a blend of data engineering and testing expertise.
The Data Quality Engineer will be responsible for implementing robust test frameworks, writing automation test cases, and collaborating closely with data engineers to validate and verify the functionality of data pipelines and processes.
This is a key role in maintaining the integrity of our data platform and driving continuous improvement in data quality standards.

Technical Skills:

• Proficiency in data engineering technologies such as Azure Databricks, Synapse Analytics, and SQL Hyperscale.
• Strong programming skills in Python and PySpark for developing automation test scripts.
• Experience with building and implementing test frameworks for data-centric applications in Azure cloud environments.
• Knowledge of data quality assurance methodologies and best practices.
• Familiarity with version control systems and CI/CD pipelines for automated testing and deployment.
• Understanding of data modeling, ETL processes, and data warehousing concepts.

Key Responsibilities:

• Collaborate with data engineers to understand data pipelines, transformations, and business rules to develop comprehensive test strategies.
• Design, implement, and maintain test frameworks for validating data quality, completeness, and accuracy across all stages of the data lifecycle.
• Develop automation test scripts using Python and PySpark to execute test cases against data pipelines and processes.
• Conduct regression testing to ensure the stability and reliability of data pipelines after code changes or updates.
• Implement monitoring and alerting mechanisms to proactively identify and address data quality issues in production environments.
• Work closely with cross-functional teams to define acceptance criteria and ensure that data quality requirements are met.
• Document test cases, test results, and defects to facilitate collaboration and knowledge sharing within the team.
• Continuously evaluate and improve testing processes and methodologies to enhance data quality assurance practices.
• Stay updated on emerging technologies and trends in data quality engineering and incorporate them into our testing practices as appropriate.

To know more about current opportunities at LeadStack, please visit us at https://leadstackinc.com/careers/

Should you have any questions, feel free to call me on or send an email on akhil.dhingra@leadstackinc.com or 415 873 3646.