Urdu AI Evaluator

Posted yesterday

virtual vocationsDenver (CO)

Computer ProgrammersAll Other Professional, Scientific, and Technical Services

SENIORITY

Junior

About the role

To enhance AI chatbot performance, the contracted Urdu AI Evaluator will remotely test and evaluate various AI models through structured interactions, contributing insights to improve response quality. Key responsibilities Testing and evaluating AI chatbots or language models through structured conversations Conducting voice-based interactions with AI models and submitting recorded sessions as part of the evaluation Providing deliverables such as write-ups, ratings, and screenshots based on specified task formats Required qualifications Native or expert-level fluency in Urdu, as spoken in Pakistan Strong English reading, writing, and communication skills Hands-on experience using AI models or large language models Access to a smartphone, computer, and reliable internet Able to pass a language proficiency and technical literacy assessment

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.