Overview:
In this Senior Software Engineer role, you will help build the NeMo Platform core, a plugin-based AI platform for running and optimizing agents at scale. You will lead cross-team architecture and deliver robust APIs, RBAC, and plugin extensions to support diverse compute backends. You’ll work in a product-research environment focused on efficient, scalable agent execution, with emphasis on reliability, performance, and open-source collaboration. This is a chance to shape a scalable, open platform that enables automated experimentation and optimization of AI agents. Compensation / Benefits equity benefits remote work options
Responsibilities:
Architect and implement an Agentic Execution system adaptable to multiple environments (local, Kubernetes, Slurm, on-prem). Provide senior technical leadership via design reviews, code reviews, and mentoring. Develop and maintain Core Platform APIs for jobs, data, entities, secrets, RBAC and authentication. Extend a flexible plugin architecture to enable external teams and customers to add capabilities. Contribute to open-source OSS repo with high standards and transparent collaboration. Deliver reliable, observable, and high-performance platform components and developer workflows. Build comprehensive test coverage across unit, integration, E2E, and containerized environments.
Key requirements:
BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related field. 10+ years of professional software engineering building production systems. Strong system design skills with focus on reliability, scalability, security, and performance tradeoffs. Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration. Excellent Python engineering skills: API design, typing, testing, debugging, performance analysis. Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces. Ability to work independently, define scope, and drive work across teams. Exceptional written and verbal communication Ability to discuss architecture with engineers, product, and marketing audiences Ambiguity tolerance and pragmatic decision-making Python Kubernetes Docker