Data Engineer -W2 only at Infowave Systems Inc

Job Title: Data Engineer (PySpark & Azure DevOps)

Location: Rocky Hill, CT (Onsite)

W2 candidates only

We are currently seeking a talented Data Engineer with expertise in PySpark and Azure DevOps to join our dynamic team.

Responsibilities:

• Develop and maintain robust data pipelines using PySpark for efficient data processing and analysis.
• Collaborate with cross-functional teams to understand data requirements and design scalable solutions.
• Implement automation scripts and tools to streamline data ingestion, transformation, and storage processes.
• Design and optimize data models for performance and scalability.
• Build and maintain CI/CD pipelines using Azure DevOps for automated testing, deployment, and monitoring of data applications.
• Parse JSON files to SQL Tables using PySpark.
• Troubleshoot and resolve issues related to data pipeline performance, reliability, and security.
• Stay updated with the latest advancements in data engineering technologies and best practices.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience working with PySpark for data processing and analysis.
• Strong proficiency in Azure DevOps with hands-on experience in creating and managing CI/CD pipelines.
• Parse JSON files to SQL Tables using PySpark.
• Solid understanding of data warehousing concepts and ETL processes.
• Proficiency in programming languages such as Python or Java.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment and effectively communicate with stakeholders.

Nice to Have:

• Experience working in the healthcare industry.
• Familiarity with healthcare data standards and regulations (e.g., HIPAA).
• Certification in Azure DevOps or related technologies.

Benefits:

• Competitive salary and comprehensive benefits package.
• Opportunities for professional growth and development.
• Collaborative and inclusive work environment.
• Cutting-edge technology stack and resources.

If you are passionate about leveraging data to drive meaningful impact in healthcare and possess the required skills and experience, we encourage you to apply and join our team of talented professionals dedicated to making a difference in patients' lives.

Infowave Systems is an equal opportunity employer that is committed to diversity and inclusion in the workplace.