QA Engineer | Remote | $30-$60/hr

Posted 2 days ago

codefeastDenver (CO)

Software Quality Assurance Analysts and Testers Custom Computer Programming Services

SENIORITY

Senior

SALARY

$30–$60/hour

Apply

About the role

QA Engineer – AI Training & Evaluation

Experience: 3–8 Years

Job Type: Contractor

Location: Remote

Compensation: $30–$60/hour

Role Overview: Contribute to LLM training and evaluation workflows by testing software, reviewing AI-generated outputs, and validating model behavior. Assess outputs for functional correctness, accuracy, reliability, edge-case handling, and adherence to requirements. Create and review test cases, test scenarios, evaluation criteria, bug reports, and quality benchmarks for AI-driven workflows. Provide detailed feedback to improve LLM performance, software quality, and reliability across complex technical tasks.

Key Requirements: 3–8 years of professional experience in QA, Software Testing, Quality Engineering, or related roles. Strong experience with manual and automated testing, test case design, debugging, API testing, and regression testing. Proficiency with Python, Java Script, Java, or similar languages, along with tools such as Selenium, Playwright, Cypress, or equivalent. Experience with or strong interest in LLM evaluation, AI-assisted testing, prompt engineering, or AI training workflows.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.