Skip to main content

Senior Software Engineer- ML Network Stack, ML Network Stack - Annapurna Labs

Posted today

amazonGranite City (IL)

SENIORITY

Lead

Apply (opens in a new tab)

About the role

Overview: In this role you will help own and optimize the EC2 network stack for distributed AI/ML workloads. You’ll collaborate across silicon, firmware, and software to scale large clusters, monitor performance, and drive fleet-wide improvements. You will build automated pipelines and dashboards to deliver insight and reliability at massive scale. This position offers the chance to shape multi-year initiatives at the forefront of AI/ML compute. You’ll work with cross-functional partners to deliver high-impact solutions that run in data centers worldwide. Compensation / Benefits work-life balance flexible working culture mentorship and career growth inclusive culture opportunity to work on cutting-edge AWS compute resources for professional development
Responsibilities: Monitor and report on functionality and performance of large testing workloads at scale Automate software delivery using internal CI/CD tools, Linux, and public AWS products Write Python to spin up large clusters and run ML/HPC benchmarks and workloads Create dashboards using AWS Managed Grafana and Athena to visualize performance data Develop automatic alerts for functional and performance regressions Manage infrastructure complexity across multiple instance types, software stacks, Linux OS releases Contribute to architecture and design reviews for multi-year initiatives Perform low-level performance investigations and collaborate with silicon/hardware partners
Key requirements: 8+ years of non-internship software development experience 8+ years of leading design or architecture of systems (design patterns, reliability, scaling) 8+ years of full software development lifecycle experience 3+ years as a mentor, tech lead, or leading engineering teams 3+ years of experience in SW/HW co-design experience with Linux, networking, and high-performance computing environments familiarity with Python, C/C++, or Rust for performance-oriented development experience with dashboards/visualization (Grafana) is a plus willingness to work across HW/SW boundaries and in a large-scale cloud environment mentorship and leadership strong cross-functional collaboration problem solving under scale Python C/C++ Rust

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this