Music Notation QA Specialist
virtual vocationsNew York (NY)
About the role
Seeking a musically literate specialist, the contract-based Full Stack Producer (Music Notation, Audio ML) will evaluate the quality of AI models related to music notation and audio, contributing to QA and data labeling efforts across various projects while working remotely.
Key responsibilities:
Expert-score every OMR and A2S release each sprint and run deeper quarterly QA cycles with AB-tests
Conduct quarterly competitor benchmarking against multiple competitors on the golden dataset and provide fast sanity checks on model candidates between releases
Build and label the Autograde golden test set, extending the QA process to adjacent projects as they scale
Required qualifications:
Strong musical literacy with the ability to read and evaluate music notation, scores, and audio performances
Experience judging OMR and audio-to-score transcription output for accuracy
Familiarity with structured/rubric-based QA scoring methodology
Comfortable evaluating a range of score types, including multilingual lyrics and various ensemble formats
Attention to detail for spot-checking datasets against ground truth
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
More like this