Senior Software Engineer - Triton Kernels - Advanced Micro Devices, Inc

WHAT YOU DO AT AMD CHANGES EVERYTHING

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world’s most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives. 

AMD together we advance_

THE ROLE: 

AMD is looking for an AI software development engineer to develop ML kernels in the Triton kernel language. We are looking for an engineer who is passionate about optimizing Machine Learning GPU kernels and improving the performance of key applications and benchmarks. What you do directly impacts the performance of AMD GPUs and enables us to become a competitive solution for generative AI. Become a part of our high-impact and incredibly talented Triton kernels team.

THE PERSON: 

The ideal candidate should have experience in parallel computer architecture and high performance GPU kernel development. Additional experience developing ML models and knowledge of ML frameworks like PyTorch or JAX is a plus.

KEY RESPONSIBILITIES: 

• Develop ML kernels for matrix multiplication, Flash Attention and other ML operators
• Benchmark, perform competitive analysis and optimize your kernels to improve performance
• Propose novel optimizations to the Triton compiler
• Collaborate with the GPU architecture team to improve future generations 

• Apply knowledge of software engineering best practices

PREFERRED EXPERIENCE: 

• Programming experience on GPUs - HIP, CUDA, OpenCL or Triton
• ML experience or knowledge in one or more of the following areas - Transformers, image models, recommendation systems
• Ability to work independently, define project goals and scope, and lead your own development effort

• Experience using debuggers
• Familiarity with PyTorch or JAX

• Knowledge of MLIR, LLVM and GPU assembly and GPU architecture is a plus
• Familiarity with models like LLama, Mixtral and Gemma is a plus
   

ACADEMIC CREDENTIALS: 

• Master's degree or PhD in Computer Science or Computer Engineering

#LI-JG1

At AMD, your base pay is one part of your total rewards package.  Your base pay will depend on where your skills, qualifications, experience, and location fit into the hiring range for the position. You may be eligible for incentives based upon your role such as either an annual bonus or sales incentive. Many AMD employees have the opportunity to own shares of AMD stock, as well as a discount when purchasing AMD stock if voluntarily participating in AMD’s Employee Stock Purchase Plan. You’ll also be eligible for competitive benefits described in more detailhere.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.