Remote Secrets Detection Evaluation Specialist

Posted 5 days ago

ai trainerNew York (NY)

Information Security Engineers Other Scientific and Technical Consulting Services

SENIORITY

Senior

Apply

About the role

AuraOne is seeking a remote Secrets Detection Security Evaluator to review model outputs and apply a versioned rubric. You will label edge cases, provide rationales, and generate regression cases for retraining, acting as an independent contractor with flexible hours. Responsibilities include comparing responses, selecting stronger answers with written justification, and tagging policy violations or potential issues for rubric updates, all while maintaining high attention to detail.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.