Humanities Evaluation Specialist
esr healthcareDenver (CO)
About the role
Humanities Evaluation Specialist Role Type: Contractor
Location: RemoteScope of Work
Develop original, high-difficulty question-and-answer pairs that challenge advanced AI models on interpretation, argument, context, and analytical reasoning within the humanities. Research, verify, and provide authoritative citations to support accurate answers and reasoning, referencing primary texts and reputable sources. Design prompts that demand deep analytical or interpretive insight rather than surface-level recall. Test questions against AI models, iterating to increase difficulty and sharpen clarity while ensuring correctness. Write with precision and attention to detail, crafting unambiguous questions and well-supported answers. Apply feedback from reviewers to refine submissions and maintain alignment with project guidelines and quality standards.
Preferred Qualifications:
Advanced academic background or professional experience in a humanities discipline such as history, literature, philosophy, linguistics, classics, art history, or journalism.
Exceptional analytical writing, close-reading, and question formulation skills.
Demonstrated meticulousness and ability to document reasoning and sources clearly.
Experience producing challenging, nuanced questions that probe for understanding beyond surface-level facts.
Self-directed and highly reliable in delivering project tasks independently within a remote context.
Familiarity with AI model evaluation or training is a plus, though not required.
Compensation Structure:
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert's experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability:
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
Company: ESR Healthcare
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
More like this