Remote Healthcare AI Rubric & Evaluation Specialist

Posted yesterday

opentrain aiBrooklyn (NY)

Training and Development Specialists All Other Miscellaneous Ambulatory Health Care Services

SENIORITY

Senior

Apply

About the role

OpenTrain AI, Inc. is seeking a remote, part-time contractor with healthcare expertise to help train AI by creating expert healthcare content and judging clinical responses. You will write challenging questions and scoring rubrics, and evaluate AI-generated clinical content for accuracy and safety. The role requires strong clinical judgment and professional English writing skills, with focus on accuracy, completeness, safety, and relevance.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.