Test Lead
pinnacle talent placementHouston (TX)
Test Lead
Posted 13 days ago
pinnacle talent placementHouston (TX)
SENIORITY
Manager
About the role
AI Test Lead
Status: Must be legally eligible to work where you live. Resume must be in English
Location:
Remote, some travel to Atlanta, GAEngagement: Contract, Long Term, Full TimeAbout the RoleWe are looking for an AI Test Lead with 10+ years of overall testing experience, including 2+ years testing AI/ML systems, to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery.
Key Responsibilities:
Define and own the AI testing strategy for applications and models.
Lead AI application testing across functional, integration, and user-facing behavior.
Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
Establish Agentic test frameworks, quality gates, and acceptance criteria for AI features.
Collaborate with data science, engineering, and product teams to embed quality early.
Report on quality metrics, risks, and readiness for release.
Required Skills & Experience:
10+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
Hands-on with AI-based testing tools and test automation.
Ability to create and drive AI testing strategy from the ground up.
Strong understanding of model evaluation metrics and AI failure modes.
Proven experience leading QA teams and mentoring testers.
Experience testing LLM / GenAI applications (prompt testing, RAG evaluation).Familiarity with CI/CD and MLOps pipelines.
Nice to have: LangFuse, Langsmith, Test Rigor of Functionize experience
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.