Skip to main content

Python AI Engineer

Posted today

epam systemsBrooklyn (NY)

SENIORITY

Senior

Apply (opens in a new tab)

About the role

Overview: In this senior Python AI Engineer role, you will help scale and evolve an enterprise knowledge base platform from a Confluence-focused RAG chatbot toward a broader, agentic system. You’ll design robust backend services, optimize retrieval quality and latency, and build production-grade agent runtime capabilities. You’ll work closely with product and engineering teams to support multiple conversational surfaces and ensure end-to-end observability and reliability. This is a hands-on opportunity to shape a scalable AI infrastructure at enterprise scale, balancing performance, cost, and safety. You will join a mission-driven effort to deliver a dependable, multi-source, hybrid retrieval platform Compensation / Benefits Medical, Dental and Vision Insurance (Subsidized) Health Savings Account Paid Time Off Paid Holidays Matched 401(k) Retirement Savings Plan Employee Stock Purchase Program
Responsibilities: Architect and implement backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, asyncpg Design trade-offs for retrieval quality, latency, cost, safety, and simplicity Build production-grade agent runtime capabilities including memory boundaries, tool sandboxing, permissions, and budgets Improve grounding, failure analysis, and citation enforcement for enterprise dependability Create observability and feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions Ingestion infrastructure across current and future content sources Full-stack observability across application, pipeline, database, and model-serving behavior Cost, latency, throughput, and failure-mode management for AI-heavy workloads Release workflows that validate AI behavior changes, not just code compilation Partner with product and engineering teams to support multiple conversational surfaces via a unified knowledge platform
Key requirements: Strong hands-on Python experience in platform or infrastructure-heavy environments Experience building CLI tools using Python, Golang, or Rust Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows Systems understanding of embedding pipelines, vector search, and LLM-backed systems Strong skills in metrics, tracing, dashboards, alerting, and log analysis Experience with ingestion, ETL, or content-processing pipelines at scale Ability to think in terms of reliability, cost, latency, throughput, and disaster recovery collaboration with cross-functional teams attention to reliability and operational discipline problem-solving mindset LangGraph LangChain pgvector

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this