HPC/ML Infrastructure Engineer
spellbrushMillbrae (CA)
HPC/ML Infrastructure Engineer
Posted 7 days ago
spellbrushMillbrae (CA)
Computer Systems Engineers/ArchitectsComputing Infrastructure Providers, Data Processing, Web Hosting, and Related Services
SENIORITY
Lead
About the role
Experienced HPC Infrastructure Engineer We're looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on what is probably the largest anime AI training cluster in the world. You'll serve as the bridge between our researchers and the bare GPU machines, helping to make sure that SLURM jobs are running, parallel filesystems are serving, network is transmitting, and that the anime models are training. Love of Anime and the Anime Aesthetic This probably one of the only jobs in the world where you will get to combine your love of anime and large-scale GPU systems. Familiarity with the Modern HPC Software Landscape Once upon a time, our team could install SLURM on a few bare metal nodes and get away with it. Now the landscape has become unbelievable complex, with SLURM deploys through Slinky on K8s, provisioning through warewulf/MAAS/ansible, filesystems through WEKA/VAST/Ceph, VPN and access through tailscale, and monitoring via the Grafana/Prometheus stack. We're looking for someone with relevant experience up and down the stack (and maybe a papercut or two to show for it!)Traditional Sysadmin Landscape Bringing up and managing cluster still requires good old linux sysadmin skills, including wrangling ldap, triaging dmesg, and setting sticky bits on directories for misbehaving users and tools. Comfort with Physical Computers We're building out edge datacenters and our CEO is still personally racking, stacking, and provisioning HGX-based nodes in our living room. Also his VLAN design sucks and he's bad at fiber routing. Please send help. Comfort Working on Small, Fast-Paced TeamsWe currently have a very tiny research team, and you'll be directly helping some of the AI researchers in the world train the best anime image model in the world. We also believe in the unmatched speed of in-person teams, and prefer on-site collaboration in either our primary research office in Tokyo (downtown Akihabara), or San Francisco (dogpatch!). Bay area is strongly preferred as we have physical hardware in the Bay Area. Visa sponsorships are available.
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.