Member of Technical Staff Agent Post-Training
embedding vcMillbrae (CA)
Member of Technical Staff Agent Post-Training
Posted 8 days ago
embedding vcMillbrae (CA)
SENIORITY
Senior
About the role
Introducing Moonlake, AI for creating world simulations. About Moonlake Moonlake is building the frontier of interactive world models: systems that generate, simulate, and reason over 3D environments for robotics, embodied AI, and interactive applications. We develop the infrastructure that enables intelligent systems to learn, evaluate, and interact within realistic virtual environments before operating in the physical world. Our work sits at the intersection of: Robotics Embodied AIInteractive 3D WorldsWorld Models Simulation Infrastructure Physical AIMoonlake is building the next generation of AI infrastructure for interactive digital worlds. Our mission is to enable anyone to create, simulate, and interact with rich environments using natural language and multimodal inputs, turning simple ideas into worlds with structure, physics, and intelligent behavior. Our team has raised $50M in seed funding from NVIDIA Ventures, Threshold Ventures, AIX Ventures, and notable angels including Naval Ravikant and Jeff Dean to build the foundational layer for the future of AI—powering everything from robotics training and simulation to digital twins and interactive environments. We are looking for exceptional engineers to help build the simulation systems that will power the next generation of robotics and embodied intelligence.
The Role:
We are hiring a Member of Technical Staff to lead reinforcement learning infrastructure and model post-training. You will work closely with Qi and the research team to improve large vision-language and code-generating agents through fine-tuning, reinforcement learning, trajectory data, and scalable evaluation. Moonlake already has deep expertise in 3D and world-building. This role adds the model-training experience needed to systematically improve agent performance and prepare the company for larger-scale RL across both digital and physical environments. We are looking for a full-stack researcher and engineer who understands the complete training system and can make strong judgments about when training is necessary, which methods are likely to work, and what not to pursue.
What You'll Do:
- Build RL and post-training pipelines for multimodal, vision-language, and code-generating agents
- Develop infrastructure for supervised fine-tuning, preference optimization, reward modeling, and reinforcement learning
- Create systems for collecting, filtering, replaying, and learning from agent trajectories
- Design rewards, verifiers, and evaluations for long-horizon agent tasks
- Improve agents' ability to plan, write and execute code, use tools, recover from errors, and complete complex workflows
- Scale distributed training and high-throughput rollout generation across multi-GPU environments
- Improve training reliability, reproducibility, observability, and cost efficiency
- Help define Moonlake's long-term strategy for agent, robotics, and embodied-model training
What We're Looking For:
- Real-world experience training large language, vision-language, multimodal, or code models
- Strong experience in reinforcement learning, post-training, or large-scale fine-tuning
- Experience building distributed training or high-throughput inference systems
- Familiarity with supervised fine-tuning, preference optimization, reward modeling, and agentic RLExperience with code-generation agents, long-horizon evaluation, or tool-using systems
- Strong Python skills and experience with PyTorch, JAX, or similar frameworks
- Ability to work across data, models, environments, rewards, evaluation, and infrastructure
- Strong research judgment and a bias toward building reliable systems
- Preferred Experience
- Experience at a frontier AI lab or organization operating large-scale training systemsExperience with code-model post-training or autonomous coding agents
- Experience with multimodal models, robotics, simulation, or embodied AIExperience designing verifiable rewards or outcome-based training systemsExperience scaling RL workloads across large GPU clusters
What Success Looks Like: Within your first year, you will have:
- Built Moonlake's core post-training and RL infrastructure
- Created scalable systems for learning from agent trajectories
- Delivered measurable improvements in agent quality and task completion
- Helped the team determine which problems require training and which do not
- Established a reliable foundation for larger-scale agent and embodied-model training
- Why This Role Matters
Moonlake's agents must do more than generate content. They must understand complex requests, reason across vision and language, write and execute code, operate tools, build interactive worlds, and recover from mistakes.
This role will build the training systems that allow those agents to continuously improve.
We are committed to being an on-site, in-person team currently based in San Francisco.
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.