Senior Software Engineer III – AI Infrastructure Jobs
$209,000 per year
Apply (opens in a new tab)Senior Software Engineer III – AI Infrastructure Jobs
Posted 7 days ago
SENIORITY
Lead
SALARY
$209,000 per year
About the role
- Design, implement, and optimize infrastructure supporting AI model inference at scale
- Lead the development, deployment, and maintenance of production AI services and applications, including retrieval-augmented generation (RAG), autonomous agents, and emerging AI technologies
- Serve as the technical lead for AI infrastructure initiatives, coordinating efforts across integrated engineering and platform teams
- Provide leadership, mentorship, coaching, and professional development support to assigned team members
- Conduct regular one-on-one meetings and provide constructive feedback to support team growth and performance
- Act as the team point of contact for contract administration and operational coordination activities
- Analyze complex and ambiguous requirements to define scalable, maintainable, and effective technical solutions
- Establish and maintain technical standards, policies, governance frameworks, and engineering best practices
- Drive the adoption of modern technologies, processes, and engineering methodologies across teams and organizations
- Implement and oversee monitoring, logging, and observability capabilities to improve platform visibility and operational awareness
- Ensure the availability, reliability, scalability, performance, and security of AI platform components and supporting infrastructure
- Collaborate with engineers, stakeholders, and leadership to align technical solutions with organizational objectives
- Communicate technical concepts, project status, risks, and recommendations to stakeholders at multiple organizational levels
- Support the continuous improvement and modernization of AI infrastructure, cloud environments, and platform operations
- Balance hands-on engineering responsibilities with leadership, coordination, and strategic planning activities
- Contribute to the long-term growth and success of enterprise AI capabilities through technical leadership and platform innovation
- Extensive experience designing, building, deploying, and operating large-scale production systems
- Deep expertise integrating complex systems across diverse technologies, platforms, and environments
- Hands-on experience with cloud engineering and solution deployment within AWS environments
- Advanced proficiency in administering Kubernetes environments and implementing modern deployment patterns
- Strong Python development skills for infrastructure, automation, and application development efforts
- Experience implementing, scaling, and maintaining observability solutions using technologies such as APM, Open
- Telemetry, Grafana, and Prometheus
- Proven ability to lead technical initiatives and drive adoption of new technologies, processes, and engineering practices
- Experience developing and implementing technical policies, standards, and governance frameworks
- Strong understanding of cloud-native architectures, infrastructure automation, and operational excellence principles
- Excellent communication, stakeholder management, and leadership skills across technical and non-technical audiences
- Ability to balance hands-on engineering responsibilities with leadership, coordination, and strategic planning activities
- Strong change management and organizational influence skills
- Strong analytical, troubleshooting, and problem-solving abilities
- Experience leading cross-functional teams and coordinating efforts across multiple stakeholders and organizations
- Ability to operate effectively within ambiguous environments and establish structure for evolving requirements
- Experience supporting the full lifecycle of cloud-native applications and platform services from design through production operations
- Experience with AI inference serving technologies such as vLLM, LiteLLM, or similar platforms
- Experience developing solutions using agentic AI frameworks such as LangChain or comparable technologies
- Knowledge of vector databases, embedding models, and semantic search architectures
- Experience designing and supporting retrieval-augmented generation (RAG) solutions and AI-enabled applications
- Familiarity with large language model deployment, optimization, and inference workflows
- Experience with high-performance computing environments and distributed systems architectures
- Knowledge of scalable data processing, distributed computing, and resource optimization techniques
- Experience supporting enterprise AI platforms and machine learning infrastructure
- Familiarity with emerging AI technologies, frameworks, and platform capabilities
- Demonstrated track record of successfully driving technical transformation and organizational change initiatives
- Experience influencing engineering culture, best practices, and technology adoption across teams
- Experience leading modernization efforts involving cloud, platform, or AI infrastructure technologies
- Ability to champion innovation while balancing operational stability and organizational objectives
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
