Data Engineer - Precision Solutions

Data Engineer

Hybrid | St. Louis, MO | As Needed Onsite

Active Interim Secret Clearance Required

Summary

Our client is an employee and Service-Disabled, Veteran-owned Small Business focused on providing niche technical services. They are a team of experienced Cyber Security professionals with a track record of success in the Federal, Commercial, and Academic workspaces. Additionally, our client designs, builds, operates, and secures scalable cloud and IT infrastructures to meet their customers’ near-term needs and fulfill their long-term requirements.

Responsibilities

Our client is seeking an experienced Data Engineer to join their team on the ADVANA initiative. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining ADVANA's data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.

• Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets
• Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency
• Troubleshoot data-related problems and provide innovative solutions to address complex data challenges
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes
• Maintain documentation for software applications, workflows, and processes
• Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement

Requirements

• 3+ years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch
• Demonstrated experience working with Military Transportation & Cargo Logistical Data
• High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
• Strong problem-solving skills and ability to solve complex data-related issues
• Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently
• Understanding of data modeling/visualization, database design principles, and data governance practices
• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams
• Detail-oriented mindset with a commitment to delivering high-quality results

Preferred Requirements

• Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus
• Recent DoD or IC-related experience
• Previous experience with ADVANA is a plus

Education/Certification Requirements

• No requirements

Clearance Requirements

• Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; an active Interim Secret clearance is required. - Please be aware that onboarding can take 4-6 weeks for this position.