Skip to main content

AI Agent Tester for Real-World Task Evaluation

Posted 16 days ago

opentrain aiNew York (NY)

SENIORITY

Junior

SALARY

$25–$45/hr

Apply (opens in a new tab)

About the role

Test two AI agents on everyday tasks such as bookings, shopping, forms, and returns using your smartphone. This remote U.S. contractor role pays $25 to $45 per hour. Remote Hourly · $25–$45/hr $25–$45/hr Compensation Contract, part-time Engagement Remote Location Oct 24, 2026 Posted Open to applicants in United States
The Work: You will test two AI agents side by side on realistic everyday errands. You will use your phone and personal accounts, guide each agent when needed, and observe how well it completes each task. You will screen record every attempt and explain what worked, what failed, and how the experience felt. Your feedback will cover completion, quality, user control, satisfaction, and time. Run scenarios involving bills, returns, email follow-ups, bookings, shopping, groceries, travel, outings, forms, and other errands. Approve or stop an agent when an important action needs your control. Document each interaction clearly from start to finish. Score each run and provide precise written feedback about the agent experience. What It Pays And Takes This is remote, part-time contractor work for candidates based in the United States. You will complete the work with a smartphone, personal accounts, and the required testing tools.
Pay: $25 to $45 per hour.
Location: Open to candidates in the United States.
Education: Bachelor's degree required.
Experience: Two to three years of experience preferred, especially in engineering, business management, office, or operations work.
Skills: Strong attention to detail, precise instruction following, clear writing, and careful step-by-step documentation.
Background: You should use AI in daily life. Generalists are welcome, and no coding background is required. Equipment and accounts: A smartphone that can record its screen, an active personal AI assistant account on the Plus tier, and active access to the required testing tools. Testing purchases: A payment card is required, and test purchases are reimbursed afterward. About AI Training Work AI training is the human work behind artificial intelligence. People test systems, review their outputs, and explain what needs to improve so AI tools work better in real situations.
Requirements
Experience: Entry level

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this