Skip to main content

About the role

Owning the research agenda for evaluating AI agents, the full-time Principal Research Scientist will design methodologies, contribute to product evaluations, and mentor teams while working remotely.
Key responsibilities: Set and maintain evaluation methodologies for AI agents, ensuring they are defensible and current Collaborate with engineers and product managers to integrate evaluation methods into existing products Mentor researchers and engineers, guiding them in evaluation design and maintaining high-quality standardsRequired qualifications 5+ years of experience in building or evaluating machine learning systems, particularly with LLMs A graduate degree (MS or PhD) in machine learning, NLP, computer science, statistics, or a related field A proven track record of original research or significant improvements in machine learning, demonstrated through publications or projects Experience managing small to medium teams, with a focus on mentoring and technical direction Strong understanding of statistical methodologies and experimental design in the context of AI evaluation

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this