Lead AI Systems Quality Engineer - Automation & Platform

Posted yesterday

f5 remoteBrooklyn (NY)

Software Quality Assurance Analysts and Testers Software Publishers

SENIORITY

Lead

Apply

About the role

Abacus Insights is building AI-driven platforms for healthcare decisions, focusing on reliability, correctness, and safety as we scale agentic systems. The Senior AI Systems Quality Engineer will help design end-to-end automated testing, guardrails, and a Databricks-MLflow-based evaluation stack to ensure production readiness. You will collaborate with AI engineers, platform and security teams to define quality criteria and release readiness, shaping how scalable, governable AI is deployed in

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.