Skip to main content

Research Intern: Speculative Decoding for Frontier LLMs

Posted 5 days ago

together computerMillbrae (CA)

SENIORITY

Intern

Apply (opens in a new tab)

About the role

Together AI in San Francisco is seeking a research intern for the Speculative Decoding team to explore faster draft-model generation for frontier open models such as DeepSeek, Kimi and GLM. You will train and fine-tune draft models at scale on GPU clusters and test ideas against realistic serving workloads. Applicants should be pursuing a Master's or Ph.D. in CS or EE, with strong ML/DL fundamentals and hands-on experience with distributed training frameworks (Megatron-LM, FSDP).

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this