Data Engineer - Scala at Jobot
New York, NY 10001
About the Job
100% Remote
This Jobot Consulting Job is hosted by: Duran Workman
Are you a fit? Easy Apply now by clicking the "Quick Apply" button
and sending us your resume.
Salary: $75 - $95 per hour
A bit about us:
We are seeking a dynamic and experienced Consulting Data Engineer - Scala in the technology industry. This role will be a key player in our team, responsible for designing and implementing data processing systems and service solutions. The ideal candidate will have a strong background in SQL, ETL, Apache Spark, and Medallion Architecture, with a minimum of 5 years of experience in a similar role.
Why join us?
Job Details
Responsibilities:
1. Design, develop, and implement ETL processes, database designs, and data models using SQL, Apache Spark, and Medallion Architecture.
2. Work closely with data scientists and analysts to understand and implement data requirements.
3. Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
4. Collaborate with stakeholders and project teams to understand business needs and devise possible solutions.
5. Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
6. Develop processes and tools to monitor and analyze data accuracy and performance.
7. Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications:
1. Bachelor's degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
2. Minimum of 5 years of experience in a Data Engineer role.
3. Experience with big data tools: Hadoop, Spark, Kafka, etc.
4. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
5. Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
6. Strong analytic skills related to working with unstructured datasets.
7. Proficient in Scala, SQL, ETL, Apache Spark, and Medallion Architecture.
8. Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
9. Experience with stream-processing systems: Storm, Spark-Streaming, etc.
10. Strong project management and organizational skills.
11. Excellent written and verbal communication skills.
12. Ability to work in a fast-paced and agile development environment.
13. Experience supporting and working with cross-functional teams in a dynamic environment.
14. Strong understanding of the latest industry trends and technologies.
Join our team and use your maximum potential. Discover new opportunities to grow your career as a Covance FSP Data Engineer. Our flexible and creative solutions improve efficiency and reduce costs for our clients. So, if you are ready to make a meaningful impact in a professionally challenging yet exciting environment, apply now!
Interested in hearing more? Easy Apply now by clicking the "Quick Apply" button.
This Jobot Consulting Job is hosted by: Duran Workman
Are you a fit? Easy Apply now by clicking the "Quick Apply" button
and sending us your resume.
Salary: $75 - $95 per hour
A bit about us:
We are seeking a dynamic and experienced Consulting Data Engineer - Scala in the technology industry. This role will be a key player in our team, responsible for designing and implementing data processing systems and service solutions. The ideal candidate will have a strong background in SQL, ETL, Apache Spark, and Medallion Architecture, with a minimum of 5 years of experience in a similar role.
Why join us?
- 100% Remote
- Recognized Top Employer
- Great Benefits for Contractor, plus 401k
- Opportunity to convert to FTE
Job Details
Responsibilities:
1. Design, develop, and implement ETL processes, database designs, and data models using SQL, Apache Spark, and Medallion Architecture.
2. Work closely with data scientists and analysts to understand and implement data requirements.
3. Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
4. Collaborate with stakeholders and project teams to understand business needs and devise possible solutions.
5. Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
6. Develop processes and tools to monitor and analyze data accuracy and performance.
7. Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications:
1. Bachelor's degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
2. Minimum of 5 years of experience in a Data Engineer role.
3. Experience with big data tools: Hadoop, Spark, Kafka, etc.
4. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
5. Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
6. Strong analytic skills related to working with unstructured datasets.
7. Proficient in Scala, SQL, ETL, Apache Spark, and Medallion Architecture.
8. Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
9. Experience with stream-processing systems: Storm, Spark-Streaming, etc.
10. Strong project management and organizational skills.
11. Excellent written and verbal communication skills.
12. Ability to work in a fast-paced and agile development environment.
13. Experience supporting and working with cross-functional teams in a dynamic environment.
14. Strong understanding of the latest industry trends and technologies.
Join our team and use your maximum potential. Discover new opportunities to grow your career as a Covance FSP Data Engineer. Our flexible and creative solutions improve efficiency and reduce costs for our clients. So, if you are ready to make a meaningful impact in a professionally challenging yet exciting environment, apply now!
Interested in hearing more? Easy Apply now by clicking the "Quick Apply" button.
Salary
75 - 95 /year