Skip to main content

Inference Systems Engineer: Scale GPU Fleets & Deployments

Posted yesterday

aitoolnavioUnion (NJ)

SENIORITY

Lead

Apply (opens in a new tab)

About the role

Luma is seeking an experienced Systems Engineer to own large-scale model serving and inference infrastructure. You will design deployment pipelines, optimize GPU utilization, and scale fleets across data centers and cloud providers. The role emphasizes reliability, performance, and collaboration with research and infra teams. You will work with Python, Kubernetes, Docker, and ML frameworks to maintain uptime and efficient inference workloads, while advancing CI/CD for model checkpoints and

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this