Senior Principal Data Engineer
$188,000 - $282,000 per year
Apply (opens in a new tab)Senior Principal Data Engineer
Posted yesterday
SENIORITY
Manager
SALARY
$188,000 - $282,000 per year
About the role
- Build/bring-your-own-agents capability (primary focus): the frameworks, SDKs, templates, interfaces, and guardrails that let teams across Vertex create, integrate, customize, and operationalize their own agents on shared platform standards
- Platform services: model integration, prompt and workflow orchestration, tool use, memory patterns, and agentic task coordination that other teams build against
- Agent lifecycle and quality: registration, configuration, testing, deployment, versioning, monitoring, and retirement, plus the evaluation and benchmarking frameworks behind them
- Developer experience: self-service onboarding, documentation, reference implementations, and enablement resources that shorten the path from idea to production
- Standards and technical leadership: platform APIs, service contracts, architecture patterns, and the engineering practices that keep custom agents safe, reliable, and supportable
- Architect and develop shared AI/agentic platform services that support enterprise AI products and internal workflows
- Design and implement a build/bring-your-own-agents capability that enables teams to create, register, integrate, deploy, and manage their own agents within the enterprise agentic platform
- Establish reusable frameworks, SDKs, templates, interfaces, and guardrails that standardize how custom agents are built and onboarded onto the platform
- Own thedeveloper experiencefor the platform, delivering intuitive self-service onboarding, SDKs, CLIs, sandbox environments, reference implementations, and clear documentation that let builders move from idea to production quickly
- Define agent lifecycle capabilities including agent registration, configuration, testing, deployment, monitoring, versioning, and retirement
- Build and maintain robust integrations with foundation models, model gateways, APIs, enterprise tools, and related AI infrastructure
- Design and implement systems for prompt orchestration, workflow execution, tool use, memory patterns, and agentic task coordination
- Develop reusable frameworks and services for evaluation, benchmarking, and validation of AI model, agent, and workflow performance
- Establish platform capabilities for observability, monitoring, tracing, logging, and alerting across AI workloads and autonomous agent interactions
- Optimize platform performance, scalability, latency, reliability, and cost efficiency for production AI and agentic systems
- Partner with product, data, engineering, security, and architecture teams to enable enterprise-ready AI solutions
- Translate prototypes and experimental concepts into hardened, maintainable, production-grade services
- Define engineering standards, best practices, and design patterns for AI platform development and deployment
- Support governance, risk management, and responsible AI practices through measurable controls, policy enforcement, and technical safeguards for agent behavior
- Drive platform adoption by creating reusable components, documentation, onboarding patterns, and developer enablement resources
- Mentor engineers and provide technical leadership across AI platform initiatives
- Evaluate emerging tools, frameworks, and architectural patterns in generative AI and agentic systems to inform platform strategy
- Bachelor's degree in Computer Science, Software Engineering, Machine Learning, Data Engineering, or a related technical field; advanced degree preferred
- Significant industry experience in software engineering, machine learning engineering, or AI platform development, including experience in senior or principal-level technical roles
- Proven track record designing and delivering production-scale AI or ML platforms
- Strong experience building distributed systems, APIs, microservices, and cloud-native applications
- Demonstrated experience operationalizing machine learning, generative AI, or agent-based solutions in enterprise environmentsExperience designing extensible platform capabilities that enable internal teams to build or integrate custom applications, tools, or services
- Deep understanding of software engineering best practices including testing, CI/CD, version control, code review, and system reliability
- Deep understanding of AI-native software engineering practices and experience establishing standards, governance, and best practices for the responsible use of AI coding assistants and software engineering agents across engineering teams
- Experience defining architecture, standards, and reusable services for large-scale enterprise environmentsExperience leading complex technical initiatives and influencing architecture across cross-functional teams
- Strong communication skills with the ability to explain complex technical concepts to varied audiences
- Experience balancing experimentation speed with production engineering discipline, security, and maintainability
- AI/ML platform architecture
- Generative AI systems and large language model integration
- Agentic workflows and orchestration frameworks
- Multi-agent or autonomous agent system design
- Prompt engineering and prompt management
- Workflow orchestration and automation
- Agent lifecycle management
- Model evaluation, benchmarking, and performance measurementAI observability, tracing, monitoring, and loggingAPI design and service integration
- Distributed systems and scalable backend engineering
- Cloud platforms and cloud-native deployment patterns
- Productionization of AI/ML services
- Reliability, latency, throughput, and cost optimizationCI/CD pipelines and DevOps/MLOps practices
- Secure software development and enterprise platform controls
- Advanced degree in Computer Science, Artificial Intelligence, Machine Learning, or a related discipline
- Experience with enterprise AI platforms, developer platforms, or internal tooling ecosystems
- Experience building frameworks or platforms that support bring-your-own-component or extensible developer patterns
- Demonstrated focus on developer experience, including designing self-service onboarding, SDKs, CLIs, sandboxes, templates, and documentation that reduce friction and accelerate time-to-first-deploymentfor internal builders
- Familiarity with model gateways, retrieval-augmented generation, and evaluation frameworks
- Experience implementing AI governance, responsible AI controls, and compliance-oriented technical solutions
- Knowledge of vector databases, knowledge retrieval systems, and orchestration layers for intelligent applications
- Experience in regulated industries such as biotechnology, pharmaceuticals, healthcare, or life sciences
- Strong mentoring and technical leadership experience in highly collaborative environments
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
