AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memor
AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memor
Posted 4 days ago
SENIORITY
Manager
About the role
- Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
- Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
- Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
- Invent and introduce state-of-the-art foundation model optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems.
- Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.
- Own the end-to-end architecture for complex AI systems - ensuring maintainability, observability, and ethical alignment
- Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift
- Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines
- Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met
- Mentor Principal and Senior Associates on scalable design, performance tuning and research-to-production translation
- Experience leading development AI systems with tradeoff decisions around cost, latency, throughput and accuracy 6+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
- Experience designing, developing, delivering, and supporting AI services
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
- Experience in building agentic AI systems and agentic workflows
- Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production
- Proficiency in designing distributed systems for model training, evaluation, and online inference at petabyte scale
- Experience defining AI model governance processes, including producibility, lineage tracking, and automated retaining schedules
- Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
