Test Job Prompt Engineer
gsobaSavannah (GA)
About the role
About the project We are seeking a project team of skilled Software Engineers to work as project consultants in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.
Location: U.S.-based experts only
Engagement: Part-time, project-based expert evaluation work Work Type: Remote Contributors will design and evaluate realistic software engineering tasks, including bug resolution, feature implementation, refactoring/migration, and test generation. Work includes both creating complex coding scenarios and reviewing peer submissions for quality and accuracy. This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).
Responsibilities: Contributors will:
- Design and implement multi-file coding tasks across bug fixing, feature development, refactoring, and testing
- Write clear natural-language specifications and reference implementations
- Develop and extend unit and integration test suites
- Review peer-generated tasks for correctness, clarity, and realism
- Identify edge cases, ambiguities, and potential failure modes
- Ensure alignment between specifications, code, and expected outputs
- Expected Outcomes:
- High-quality, production-realistic coding tasks
- Complete and correct reference implementations
- Robust test coverage and validation artifacts
- Structured, actionable peer review feedback
Qualifications:
- Advanced professional written proficiency in English3–5 years of professional software engineering experience
- Strong proficiency in Python and JavaScript/TypeScript; working knowledge of Java, C#, or GoBackend or full‑stack development experience in production systemsExperience with testing frameworks (e.g., pytest, Jest, JUnit, xUnit, Go testing)
- Proven ability to debug and navigate large, multi‑file codebases
- Experience with code reviews, refactoring, and production migrations
- Prior experience with data annotation, evaluation, or structured labeling for AI/ML systemsExperience defining solution trajectories and writing evaluation rubrics
- Familiarity with LLM evaluation, prompt design, or benchmarking workflows
LinkedIn Data Security and Privacy Notice:https://legal.linkedin.com/content/dam/legal/
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.