AI Evaluation Specialist | $50/Task

Posted 3 days ago

codefeastDenver (CO)

SENIORITY

Senior

Apply

About the role

Domain Expert – AI Prompt Design & Evaluation
Experience: Professional / Domain Expertise Required
Job Type: Contractor
Schedule: Flexible Compensation: $50 per approved task
Role Overview: We are looking for Domain Experts, Professionals, and Knowledge Workers from diverse fields to participate in a paid AI research study. You will turn a complex real-world workflow from your area of expertise into a challenging AI prompt, test it in ChatGPT, identify where the model fails, and create a structured grading rubric to evaluate AI-generated outputs.
Key Responsibilities: Convert a familiar, complex workflow into a challenging AI prompt. Test the prompt using ChatGPT and identify incomplete or incorrect outputs. Refine the task to better test the model’s reasoning capabilities. Record your screen, camera, and microphone while completing the task. Create a clear and comprehensive grading rubric. Submit the final prompt, failure notes, rubric, and generated output file.
Key Requirements: Strong expertise in a specialized professional or technical workflow. Ability to quickly evaluate the quality and accuracy of outputs in your domain. Strong reasoning, analytical, and problem-solving skills. Access to a laptop or desktop computer. Active ChatGPT account; free tier is acceptable. Comfortable completing a screen-recorded session with audio and video. Selection Process Step 1 – Application / Profile Submission Step 2 – Paid Trial Assessment Step 3 – Submission Review Step 4 – Payment & Future Opportunities

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this

AI Evaluation Specialist | $50/Task Jobs at codefeast | David Careers