Senior Data Products Engineer - PySpark, Databricks - Eliassen Group
Boise, ID
About the Job
Senior Data Products Engineer - PySpark, Databricks
Anywhere
Type: Contract
Category: Data
Industry: Retail
Workplace Type: Remote
Reference ID: JN -102024-91353
Date Posted: 12/20/2024
Shortcut: http://careers.eliassen.com/8CvKrx
+ Description
+ Recommended Jobs
Description:
We’re recruiting a Data Products Engineer with software development experience to implement robust data pipelines, API’s, and scalable software solutions with best-practice data architectures. We want you to leverage your leading expertise in data engineering, software development, and cloud technologies to design and optimize the data infrastructure for a highly complex, employee-facing data and analytics web application. Team players only, with emphasis on openness, honesty, reliability, and mature competency.
_Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance._
_Rate: $80 - $90 / hr. w2_
Experience Requirements:
+ 10+ years of professional experience in data engineering and software development roles
+ EXTENSIVE experience in Medallion Architecture, Databricks Development, and building robust data platforms for streaming / real time applications
+ Hands on experience with PySpark and Python, including multiple libraries
+ Great understanding of how data moves throughout an organization, data validation, cleansing, etc.
+ Proven track record in Agile software product development
+ 7+ years in programming languages like Python, Java, or Scala
+ Extensive experience with Databricks and Azure are a must
+ Experience with other data technologies such as Databricks and Hadoop, Spark, or Kafka are a plus
+ Strong understanding of database technologies (SQL and NoSQL) and data modeling
+ Expertise in designing and implementing scalable data pipelines and ETL processes
+ Experience designing and developing APIs for data access and integration
+ Strong understanding of software engineering principles, including design patterns and version controls
+ Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred
+ Previous experience as a member of an Inaugural Dev Team or start-ups is a plus.
Critical technologies for this role:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure SQL DB
- Azure Data Lake Storage (ADLS)
- Azure Cosmos DB
- Azure DevOps
- Python
- SQL
- Spark / PySpark
- Scala
- Advanced Scripting with Bash/Powershell
- ETL Pipelines
- Data Modeling
- Object-Oriented Programming (OOP)
- Functional Programming
- Test-Driven Development (TDD)
- Clean Code Principles
- Version Control (Git)
_Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range._
_W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality._
_Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact InfoSec@eliassen.com._
_About Eliassen Group:_
_Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate._
_Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status._
_Don’t miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a $1,000 referral check!_
Anywhere
Type: Contract
Category: Data
Industry: Retail
Workplace Type: Remote
Reference ID: JN -102024-91353
Date Posted: 12/20/2024
Shortcut: http://careers.eliassen.com/8CvKrx
+ Description
+ Recommended Jobs
Description:
We’re recruiting a Data Products Engineer with software development experience to implement robust data pipelines, API’s, and scalable software solutions with best-practice data architectures. We want you to leverage your leading expertise in data engineering, software development, and cloud technologies to design and optimize the data infrastructure for a highly complex, employee-facing data and analytics web application. Team players only, with emphasis on openness, honesty, reliability, and mature competency.
_Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance._
_Rate: $80 - $90 / hr. w2_
Experience Requirements:
+ 10+ years of professional experience in data engineering and software development roles
+ EXTENSIVE experience in Medallion Architecture, Databricks Development, and building robust data platforms for streaming / real time applications
+ Hands on experience with PySpark and Python, including multiple libraries
+ Great understanding of how data moves throughout an organization, data validation, cleansing, etc.
+ Proven track record in Agile software product development
+ 7+ years in programming languages like Python, Java, or Scala
+ Extensive experience with Databricks and Azure are a must
+ Experience with other data technologies such as Databricks and Hadoop, Spark, or Kafka are a plus
+ Strong understanding of database technologies (SQL and NoSQL) and data modeling
+ Expertise in designing and implementing scalable data pipelines and ETL processes
+ Experience designing and developing APIs for data access and integration
+ Strong understanding of software engineering principles, including design patterns and version controls
+ Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred
+ Previous experience as a member of an Inaugural Dev Team or start-ups is a plus.
Critical technologies for this role:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure SQL DB
- Azure Data Lake Storage (ADLS)
- Azure Cosmos DB
- Azure DevOps
- Python
- SQL
- Spark / PySpark
- Scala
- Advanced Scripting with Bash/Powershell
- ETL Pipelines
- Data Modeling
- Object-Oriented Programming (OOP)
- Functional Programming
- Test-Driven Development (TDD)
- Clean Code Principles
- Version Control (Git)
_Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range._
_W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality._
_Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact InfoSec@eliassen.com._
_About Eliassen Group:_
_Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate._
_Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status._
_Don’t miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a $1,000 referral check!_
Source : Eliassen Group