Software Engineer-Apache Spark, Airflow, Databricks at Rose International

Seeking a Software Engineer who thrives on designing, coding, and maintaining large data processing systems, primarily in the Spark framework using Scala. Our ideal candidate will understand the challenges of working with data at scale and have a firm knowledge of algorithms and processing complexity.
Our team is a mix of software engineers and data analysts working to ensure our inputs, algorithms, and publishing artifacts are of the highest quality and efficiency. Our output is critical to the accuracy of our Risk Analysis APIs which power top e-commerce sites.

As a Software Engineer for the Graph and Tools Team, you will:
- Write and own technical test design and execution as a member of an Agile-based Scrum team with an emphasis on automation, tooling, and scripting skills
- Assist in a technical test role to help drive data quality and to build, implement and execute tests and automation improvements for our core processes and publishing cycle
- Work closely with software engineers on the team in expanding test automation framework and test coverage, and on assigned projects to assist in testing and implementation tasks
- This is a technical position and requires writing, interpreting, and reviewing both test and application code
- Understand the big picture and end-to-end logical architecture of systems and various Graph core processes
- Documents test strategies and test plans; translates complex system requirements and specs into test requirements and testing methods
- Be able and willing to take an innovative approach towards testing and troubleshooting new technologies primarily focused on Big Data
- Be an integral part of the Agile SAFe scrum, sprint planning and backlog grooming sessions
- Communicate, collaborate, and work effectively in a global environment.
- Understand the use of Mastercard technology policies in everyday work
- Demonstrate active learning and sharing of software practices via Guild/Engineering community initiatives

Our ideal Software Engineer will have:
- Ability to create good acceptance and integration test automation scripts and integrate with Continuous integration (Jenkins/Bamboo) and code coverage tools (Sonar) to ensure 80% or higher code coverage
- A proactive attitude and the knowledge and ability to help influence and shape the QA process to drive the team to deploy quality data
- Experience working with cloud-based server environments (AWS)
- Specific language knowledge: Scala, Java, Python
- Experience with some of the big data technologies like Apache Spark, Airflow and Databricks
- Experience using team collaboration and bug tracking tools (Jira, etc.)
- Self-motivated learner willing to take on challenging problems
- Aptitude to learn new languages and technologies as necessary
- Passion for diving deep in data and insights
- In-depth knowledge of one or more Internet protocols
- Experience with one or more strongly typed programming languages
- BS degree in Computer Science, related degree, or equivalent

Benefits:

For information and details on employment benefits offered with this position, please visit here .Should you have any questions / concerns, please contact our HR Department via our secure website .

California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer.All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender(expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law.Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).