Data Engineer from Collabera

Position Details:

• 
  
  Enterprise Business Technology Office is looking for a Data Engineer Senior who enjoys data and building data platforms.
  
  


• 
  
  Our ideal candidate is passionate about data management and partners closely with various stakeholders to influence decisions with data in making key business decisions in a timely manner.
  
  


• 
  
  You will be part of a group that supports a variety of internal customers.
  
  


• 
  
  You will analyze, design, and develop data storage and data analytic solutions using data lake patterns, that help our customers run more effective operations and make better business decisions.
  
  

• 
  
  We build various data governance solutions which run as cohesive unit within the overall data platform strategy.
  
  


• 
  
  We bring pioneering technology to bear on business challenges to delight and excite our customers.
  
  


• 
  
  We collaborate with other IT teams to advance our technical capabilities.
  
  


• 
  
  We live to automate and optimize processes and technologies.
  
  

• 
  
  As a Senior Data Engineer, you are expected to work under limited direction and independently determine and develop approaches to solution. Understand requirements and design for the build and deployment.
  
  


• 
  
  Scrum/agile based development and maintain efficient data pipelines and ETL process for large-scale data integration.
  
  


• 
  
  Collaborate with data analysts and other engineer to define data needs and build solution that drive business insights.
  
  


• 
  
  Develop, test, and deploy code for data extraction, transformation and loading processes (ETL/ELT).
  
  


• 
  
  Develop and maintain automated test scripts using Pytest to ensure high-quality software releases.
  
  


• 
  
  You will be a mentor and bring up-to-speed junior resources and consultants on technologies/products that the team works on and Represent and Demonstrate your team’s work to customers.
  
  


• 
  
  Will demonstrate your coaching and mentoring skills to help teams continuously grow and improve in delivering high quality software solutions.
  
  


• 
  
  Support line of business areas with more advanced statistical and quantitative analysis. Ability to run models, look for exceptions and take corrective actions where necessary.
  
  


• 
  
  Use technology tools to conduct analysis; apply techniques such as SQL querying and macro development to extract data for populating models.
  
  


• 
  
  Release Support: Work closely with internal/external teams to help with the release process, ensuring smooth and error-free releases to production.
  
  


• 
  
  Interact directly with customers to gather feedback, troubleshoot issues, and ensure that the product meets their expectations.
  
  

• 
  
  Bachelor’s degree in computer science or related discipline; advanced Studies/ Degree preferred.
  
  


• 
  
  5-7 years of experience in data engineering with strong proficiency in Python programing language (Nice to have: Scala, Java).
  
  


• 
  
  Strong proficiency in spark SQL, SQL, gremlin, GraphQL and database management (Snowflake cloud-base warehousing).
  
  


• 
  
  Strong experience with data processing frameworks, DataFrames, Apache Spark, Graph DBs
  
  


• 
  
  Experience with cloud platform AWS (EMR, EKS, Lambda).
  
  


• 
  
  Experience writing statistical and/or optimization programs to develop models and algorithms.
  
  


• 
  
  Programming languages may include—but are not limited to—Python, R
  
  


• 
  
  Solid understanding of SDLC practices including development, testing, and release management.
  
  


• 
  
  Experience with version control systems such as Git, BitBucket
  
  


• 
  
  Experience with RESTful API design and development.
  
  


• 
  
  Familiarity with PySpark for large-scale data processing and analysis.
  
  

• 
  
  Ability to use data to help inform strategy and direction.
  
  


• 
  
  Ability to translate complex statistical models and methodologies into simple business terms.
  
  


• 
  
  Help with pytests, testing frameworks, SDLC expertise.
  
  


• 
  
  Help with data modeling, data engineering efforts, proper python expertise
  
  


• 
  
  Interact with customers and stay on top of issues, understand our platform, and debug issues.
  
  


• 
  
  Help with talend, control-m, APIs.
  
  


• 
  
  Hands-on help with our team release, customer release etc.
  
  


• 
  
  Pyspark, spark, sql knowledge.
  
  


• 
  
  Strong leadership, planning and communication skills.