Senior Software Engineer (Spark/Hadoop) - Optomi
Glendale, CA 91222
About the Job
Senior Software Engineer (Spark & Hadoop) (HYBRID!)
Optomi, in partnership with an industry leader within the media & entertainment industry, is seeking an experienced Senior Software Engineer for their team! This role is hybrid, and they ask that you live near one of their hubs in San Francisco, Glendale, Seattle, or Santa Monica! In addition, this Senior Software Engineer will collaborate with product/program managers, software developers and analysts in an open, creative environment. You will design, architect, develop, scale, and improve their data platform and its services!
What the right candidate will enjoy:
- Answering difficult data questions and enjoy the startup play hard/work hard environment.
- Working with a market leader in the media and entertainment industry!
- Helping build the next-generation data analytics platform utilizing the most advanced big data technologies.
Experience of the right candidate:
- Minimum of 3 years of related work experience
- Strong programming (Scala/Java) and shell scripting skills
- Experience with real-time processing technologies like Spark/Storm/Flink
- Experience with Hadoop/Hive
- Knowledge of cloud big data services and technologies
- Knowledge of lambda architecture and data-warehousing concepts
- Self-motivated, collaborative, proactive, and capable of committing to results under pressure and ambiguity
- Experience in Software Development Lifecycle and its activities
- Experience with Couchbase and/or MemSQL
- Bachelor’s degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience
Responsibilities of the right candidate:
- Design, architect, develop, scale, and improve our data platform and its services.
- Implement large-scale high-throughput solutions using on-premise and cloud technologies such as Kafka, Spark on Hadoop/Hive/S3, AWS Lambda, Terraform, Kubernetes, etc.
- Participate in novel solutions to challenging technical problems, introduce new technologies to our data platform and its services.
- Diagnose and debug issues in development, staging and production environments.
- Collaborate with product/program managers, software developers and analysts in an open, creative environment.
Must be able to work in the United States without sponsorship