Big Data Engineer - ConsultNet
Rockville, MD 20850
About the Job
Big Data Engineer
Location: Fully remote in the continental US. Work outside of the US not permitted
Contract to Hire, long term contract
Job Description:
Our client currently runs an anomaly detection environment that is made up of both rule based and machine learning 'patterns' that are scanning daily trade data in excess of 235 billion market events/day. Our client has plans to expand the surveillance capabilities of these patterns is looking for some of the most talented big data engineers in the country! Big data engineers in this environment need to have previous data engineering experience, have expertise in SQL and be able to code in Java, Scala and/or Python. Previous big data experience is not a requirement but is huge preference for the client since their data set is so massive.
Required:
ConsultNet is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, ancestry, citizenship, disability, age, military or veteran status, and other characteristics protected under federal, state and local law.
Location: Fully remote in the continental US. Work outside of the US not permitted
Contract to Hire, long term contract
Job Description:
Our client currently runs an anomaly detection environment that is made up of both rule based and machine learning 'patterns' that are scanning daily trade data in excess of 235 billion market events/day. Our client has plans to expand the surveillance capabilities of these patterns is looking for some of the most talented big data engineers in the country! Big data engineers in this environment need to have previous data engineering experience, have expertise in SQL and be able to code in Java, Scala and/or Python. Previous big data experience is not a requirement but is huge preference for the client since their data set is so massive.
Required:
- Spark expertise in AWS environment
- Experience in Hadoop ecosystem, must also have experience with HIVE, Presto
- AWS expertise with services related to big data EMR and S3 Data lakes
- Strong SQL
- Scala coding experience
ConsultNet is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, ancestry, citizenship, disability, age, military or veteran status, and other characteristics protected under federal, state and local law.
Source : ConsultNet