Senior Research Data Scientist - Rose International
Seattle, WA 98101
About the Job
Description:
Senior Research Data Scientist
Location
Strong preference for candidates located in Seattle. Secondary location preference: New York, San Diego, or the Bay Area.
Exceptionally strong candidates outside these areas will be considered.
Job Summary
We are seeking a highly skilled and motivated Data Scientist to join our Responsible AI team. In this role, you will be responsible for designing, coordinating, supporting, and executing evaluations of large language model (LLM) features to ensure their safety, fairness, and alignment.
You will work closely with multidisciplinary teams, including Research Scientists, Product Managers, Engineers, and other Data Scientists, to drive human-centric evaluations that inform product decisions and improve model performance.
This position requires a combination of strong technical skills, experience in industry settings, and a deep understanding of human-centered data science. Familiarity with responsible AI principles and practices is a strong plus.
Key Responsibilities
•Design, implement, support, and evaluate experiments for LLM feature safety, including both human and automated evaluations.
•Develop scalable pipelines and tools to process and analyze heterogenous datasets.
•Collaborate with cross-functional teams to operationalize research findings
•Write high-quality, maintainable code, and contribute to shared codebases
•Create and maintain documentation for research processes and evaluation frameworks.
•Communicate findings effectively through presentations and reports, translating technical results into actionable insights for diverse audiences.
Key Qualifications
•Strong programming skills in Python, with experience in writing production-level code and implementing best practices (e.g., unit testing, version control).
•Experience with data engineering, including working with large datasets or heterogenous datasets with mixed provenance.
•Solid understanding of machine learning concepts, particularly related to LLMs, NLP, and model evaluation.
•Experience designing and executing experiments, including human-centered evaluations and automated benchmarking.
•Experience in observational or experimental research with human subjects.
•Familiarity with SQL for data manipulation and analysis.
•Strong analytical and problem-solving skills, with experience applying statistical methods to real-world problems.
•Excellent verbal and written communication skills, with experience in explaining technical concepts to non-technical stakeholders.
Strongly Preferred
•Hands-on, technical experience solving data science or ML problems with LLMs, preferably in an applied industry context
•Experience with responsible AI, including fairness, transparency, and safety in AI systems.
•Background in human-centered data science, HCI, or social science fields relevant to understanding human-AI interactions or measuring human-centered phenomena.
Education
Master’s or PhD in Computer Science, Machine Learning, Data Science, Statistics, Cognitive Science, Psychology, Human-Computer Interaction, or a related field.
**Only those lawfully authorized to work in the designated country associated with the position will be considered.**
**Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**
Benefits:
For information and details on employment benefits offered with this position, please visit here .Should you have any questions / concerns, please contact our HR Department via our secure website .
California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an Equal Opportunity Employer.All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender(expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law.Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.
Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).