Product Content Engineer
$190,000 per year
ApplyProduct Content Engineer
Posted yesterday
SENIORITY
Lead
SALARY
$190,000 per year
About the role
- Build and maintain evaluation rubrics for image and video generation quality, including dimension definitions, rating scales and annotator guidelines* Execute human evaluation rounds on model output, side-by-sides, absolute scoring and prompt-adherence checks, and produce clear, actionable writeups* Construct and curate prompt sets and golden sets that stress-test specific model capabilities and failure modes* Calibrate with fellow raters and vendor teams; help drive inter-rater reliability* Partner with research and modeling teams so eval findings translate into training and post-training signal* Support the transition of human judgment into automated measurement and help validate automated scores against human ground truth* Track quality trends across model versions and flag regressions early* Deliver high-quality evaluation work on model and launch timelines in a fast-paced, dynamic environment
- 6+ years of experience in video production, content strategy, editorial standards, media evaluation or relevant fields* Hands-on video production experience, including shooting, editing, post and/or motion work, with the craft vocabulary to describe quality failures precisely* Experience creating or substantially contributing to evaluation rubrics or quality guidelines for video or image content* Experience producing or evaluating short-form video and emerging video formats* Experience applying editorial judgment, plus the ability to document judgment logic into reusable frameworks that scale across teams* Experience leveraging quantitative insights to inform content and quality decisions* Experience collaborating with cross-functional teams (product, engineering, design, research, analytics)* Experience working independently and navigating ambiguity in fast-paced environments* Bachelor's degree in a directly related field, or equivalent practical experience
- Experience evaluating generative media output (text-to-video, image-to-video, video-to-video, text-to-image)* Background in film, television, OTT, commercial or VFX production* Familiarity with generative media tooling and prompt engineering for media generation* Experience with annotation platforms or eval tooling* Experience with product launches in ambiguous or zero-to-one environments* Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)* Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)* Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
More like this
