Skip to main content

Lead, AI Quality & Reliability Engineering

Posted yesterday

vizientEdina (MN)

SENIORITY

Manager

Apply (opens in a new tab)

About the role

Overview: In this role, you drive the day-to-day execution of AI Quality Engineering initiatives to support Vizient’s enterprise AI transformation. You establish and mature AI-quality practices, validation processes, and AI-assisted testing frameworks to ensure reliable, governable AI-powered solutions in healthcare. You lead hands-on quality engineering while coordinating with cross-functional teams to deliver high-quality, scalable AI outcomes. This role offers a meaningful chance to shape practices that enable responsible deployment and operational excellence in AI-enabled systems. Compensation / Benefits comprehensive benefits plan incentive eligible competitive compensation range opportunity to impact AI-driven healthcare solutions career development opportunities
Responsibilities: Lead day-to-day AI Quality Engineering activities across AI-powered applications, LLM-enabled workflows, and intelligent automation Mature AI-quality practices, including AI-native testing approaches, validation, runtime quality controls, and scalable testing frameworks Coordinate AI validation efforts: functional, prompt, workflow, regression testing, defect management, release readiness, production QA Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to scale quality processes Support runtime quality and reliability through observability, monitoring, telemetry, incident support, drift detection, and continuous improvement Promote AI-assisted testing, reusable test assets, and modern quality engineering practices to boost efficiency and outcomes Lead delivery coordination: sprint planning, testing, risk, dependencies, and release support Collaborate with clinical, operational, and engineering stakeholders to validate healthcare workflows and AI-enabled business processes Mentor quality engineers, analysts, contractors, and delivery teams; foster continuous learning and accountability
Key requirements: 7+ years in Quality Engineering, Software Testing, Quality Assurance, or related fields Experience with AI-powered applications, ML solutions, LLM-enabled workflows, or AI technologies Experience implementing test strategies, validation frameworks, automation solutions, and quality controls in complex enterprises Knowledge of AI Quality Engineering concepts: AI validation, prompt testing, model evaluation, runtime assurance, observability, monitoring, production reliability Experience partnering with cross-functional teams including Engineering, Product, Data, Security, Governance, Clinical, and Operations Proven ability to lead testing efforts, manage quality risks, coordinate releases across multiple initiatives Strong analytical, problem-solving, and communication skills translating technical quality into business actions Experience in healthcare, payer, provider, or highly regulated industries preferred Experience with AI-assisted testing tools, test automation frameworks, observability platforms, and modern software delivery practices Authorized to work in the United States without sponsorship strong communication leadership and mentorship cross-functional collaboration AI Quality Engineering AI validation and prompt testing model evaluation and runtime assurance

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this