Senior Data Engineer - EPCVIP, Inc

Job Overview

We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our software engineers, database architects and analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Responsibilities:

• Develop core data relationship, data ingest, data transformation services and search capabilities.

• Maintain all facets of data infrastructure, including backups/disaster recovery, software deployment/configuration, security best practices, performance tuning, and troubleshooting.

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies

• Review project objectives and determine best technology for implementation. Implement best practice standards for development, build and deployment automation.

• Design, maintain and optimize highly distributed analytics data stores

• Write well-abstracted, reusable and efficient code

Requirements:

• 5+ years of relevant Data Engineering technical experience

• Bachelor’s degree in Technology based discipline preferred.

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases

• Build processes supporting data transformation, data structures, metadata, dependency and workload management

• Experience with AWS cloud services: Lambda, S3, Glue, Redshift, and Athena, or their open source equivalent (Zeppelin, Presto, etc)

• Experience with data pipelining with AWS Datapipeline, Airflow or Luigi

• Experience with object-oriented/object function scripting languages: Python code development, python unit testing (tox), Pyspark

• Up-to-date on latest industry trends; able to articulate trends and potential clearly and confidently

• Understanding of best practices within the development process

Benefits:

• 401K
• Paid Vacation and Sick Time off
• Paid Parental Leave
• Health, Dental and Vision Insurance Coverage
• Short term/Long Term Disability Insurance Coverage
• Life Insurance Coverage

Perks:

• Wellness Reimbursement
• Tuition Reimbursement
• In-home Vet Care
• Referral bonus
• Relocation Assistance
• Free parking
• Friday lunch catering
• Daily free snacks and drinks
• Yearly mini paid holiday company trip
• Lunch and Learn Sessions

AFFIRMATIVE ACTION/EQUAL OPPORTUNITY EMPLOYER
EPCVIP, Inc is an affirmative action and equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, criminal history, genetic information or any of the protected classes. EPCVIP, Inc is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation, contact Human Resources at hr@epcvip.com.