Program Manager III, GenAI Adversarial Testing, YouTube - Google
San Bruno, CA
About the Job
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 5 years of experience in program or project management.
- Experience with Generative AI models, including their capabilities, limitations, and potential risks.
- Experience in a Trust and Safety domain.
Preferred qualifications:
- 5 years of experience managing cross-functional or cross-team projects.
- Experience in designing and implementing adversarial testing or red teaming programs for large-scale AI systems.
- Experience in developing content policies for consumer products, with a view towards GenAI responsibility.
- Experience with release management lifecycles and project milestones, keeping up a high velocity in a fluid environment.
- Ability to be an influential member of a team composed of both technical and non-technical members.
About the job
A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you will lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.Our goal is to build a Google that looks like the world around us — and we want Googlers to stay and grow when they join us. As part of our efforts to build a Google for everyone, we build diversity, equity, and inclusion into our work and we aim to cultivate a sense of belonging throughout the company.
In this role, you will grow YouTube’s responsible innovation with a focus on designing and implementing scalable ways of assessing and mitigating adversarial risks. You will serve as the architect and operator of the Adversarial Testing program - building, running and scaling our programmatic approach to Adversarial Testing processes from initial risk assessment to evals, analysis and launch readiness. You will collaborate with cross-functional teams, including Product, Intel, Engineering, Policy and Operations.
At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.The US base salary range for this full-time position is $139,000-$207,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.Responsibilities
- Design, manage and continuously improve the lifecycle of adversarial testing, from intake and risk assessment to test set generation, execution, evaluation, and launch readiness in partnership with cross-functional teams.
- Conduct feature risk assessments to identify vulnerabilities, weak points, abuse vectors, and sensitive output types. Build infrastructure and processes to operationalize strategies and experience across Responsibility launch-readiness workflow.
- Work closely with Product and Policy teams driving alignment on policy issues and decisions.
- Establish program metrics and feedback loops to continuously improve the program health, quality of test sets, Red Teaming program and raters.
- Identify process bottlenecks, develop solutions, and drive continuous improvement and organizational awareness across YouTube.