Research Scientist, Artificial Intelligence
$184,000 - $257,000 per year
Apply (opens in a new tab)Research Scientist, Artificial Intelligence
Posted today
SENIORITY
Lead
SALARY
$184,000 - $257,000 per year
About the role
- Lead the design and execution of TPU performance optimization research, including kernel development, memory optimization, and compute efficiency improvements
- Develop and optimize Pallas kernels for large-scale model training and inference on TPU architectures
- Drive model optimization techniques including Mixture of Experts (MoE), tensor parallelism, pipeline parallelism, and other distributed training strategies
- Optimize first party models within Meta's native PyTorch stack, ensuring efficient integration with XLA compilation and TPU execution
- Identify and resolve complex technical challenges in model training efficiency, inference latency, and system reliability that require novel approaches
- Define and drive multi-quarter research roadmaps for TPU optimization, aligning project milestones with broader organizational goals
- Establish rigorous experimentation frameworks for performance benchmarking, including metric selection, profiling methodology, and data-driven optimization decisions
- Translate research findings into production-ready optimizations by collaborating with engineering teams on deployment pipelines and reliability at scale
- Communicate research findings and technical trade-offs clearly through publications, design documents, and presentations to both technical and non-technical audiences
- Mentor other researchers and engineers on TPU optimization techniques, providing structured feedback on technical direction and experimental rigor
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience 8+ years of experience in machine learning systems, model optimization, or high-performance computing research
- Experience with TPU architecture and performance optimization, including profiling, kernel development, and memory management
- Experience with XLA compilation, graph optimization, and low-level performance tuning for accelerator hardware
- Experience developing and optimizing large-scale distributed training systems, including parallelism strategies such as data, tensor, and pipeline parallelism
- Experience with PyTorch and its integration with accelerator backends
- Experience communicating complex technical findings in writing, including technical reports, design documents, or peer-reviewed publications
- Experience developing custom kernels using Pallas or similar kernel authoring frameworks for TPU or GPUDemonstrated track record of transitioning performance research into deployed systems used at significant scale
- PhD in Computer Science, Machine Learning, Computer Architecture, or a related technical field, or equivalent depth of research experience
- Publication record in systems for ML venues such as MLSys, OSDI, SOSP, or related AI conferences such as NeurIPS, ICML, or ICLRExperience with Mixture of Experts (MoE) architectures and their optimization for efficient training and inference
- Experience optimizing production-scale models with billions of parameters
- Public Compensation:$184,000/year to $257,000/year + bonus + equity + benefits
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
