Skip to main content

Inference Platform Engineer: Scale, Latency, Reliability

Posted 2 days ago

archerMillbrae (CA)

SENIORITY

Lead

Apply (opens in a new tab)

About the role

Sierra is seeking an experienced infrastructure engineer to design and operate its inference architecture across self-hosted models and third-party providers. You will run and optimize production inference infrastructure focusing on latency, reliability, throughput, and cost, while collaborating with research, model, runtime, and provider teams. Candidates should have strong distributed-systems fundamentals and experience building and operating large-scale production infrastructure; experience

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this