Remote AI Prompt Evaluator & Quality Assurance Specialist

Posted 16 days ago

crossing hurdlesNew York (NY)

Computer Programmers Other Management Consulting Services

SENIORITY

Senior

SALARY

$35-$40/hour

Apply

About the role

A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This mid-senior level role offers flexible hours (10-40/week) and competitive compensation of $35-$40/hour.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.