About the role
Legal Subject Matter Expert (SME) – Quality Review & AI Evaluation
Location: Remote
Duration: 3 months with possibility to extend
Hours:
ranging from 40-70 hours/week depending on business needs Our Client is looking for their next Legal SME!
Required:
Experience supporting legal recruiting in a nationally or internationally recognized law firm.
Role summary:
This contractor will support in executing a high-priority eval campaign by monitoring the end-to-end data collection process, performing quality control on incoming data, and keeping throughput high without compromising standards. The role requires legal domain fluency to reliably judge realism, feasibility, and correctness expectations for legal workflows. Scope of responsibilities Incoming Data Quality Control (QC)Review tasks and rubrics to confirm they meet campaign standards (complexity, feasibility, completeness, clarity) and legal-domain standards (e.g., correct terminology, workflow realism, appropriate constraints, reasonable deliverable expectations).Ensure tasks do not require inaccessible systems or privileged information (unless explicitly permitted).Validate legal realism: proper framing (jurisdiction/context), reasonable assumptions, appropriate deliverable types (memos, issue spotting, drafting, research outlines, etc.).Identify and correct common legal-domain failure patterns (missing jurisdiction, overbroad prompts, impossible deadlines, unclear client goals).Provide actionable feedback and track resolution. Data Collection Process Monitoring Monitor campaign health and throughput (submission volume, rework rates, bottlenecks, common failure modes).Proactively flag blocked contributors/reviewers, recurring quality issues, or emerging drift from guidelines. Maintain lightweight QC logs/audit trails to support retrospectives and downstream analysis. Contributor Support and Coordination (as needed)Answer contributor questions to improve first-pass quality and reduce iterationcycles. Coordinate with reviewers on edge cases and escalate ambiguous decisions quickly. Produce weekly (or ad hoc) summaries: quality themes, top issue categories, andrecommended guideline updates. Technical Work (light)Run simple Python scripts and SQL queries, spot anomalies, and support workflow optimization or automation Additional tasks (as needed)Draft/update legal-specific examples, checklists, and “good vs. bad” task patterns. Participate in QA sweeps for high-risk segments and new task templates. Assist tagging/categorization for analysis. Qualifications / profile 3+ years in legal field, including legal ops Strong attention to detail and comfort applying rubrics consistently. Able to write clear feedback that improves quality quickly. Comfortable with spreadsheets; basic SQL/Python helpful but not required
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
More like this