AI QA Engineer - Test Specialist
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: QA/Test Engineer
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
- Design test cases to confirm each task works as intended, including tricky edge cases.
- Review tasks and reference solutions to catch ambiguity and gaps early.
- Debug using Python when tasks or checks don't behave as expected.
- Shape quality checklists and provide actionable feedback to authors.
- Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs.
Qualifications
Must-Have
- MSc or PhD in a STEM field or equivalent practical experience.
- 1+ years in test engineering, quality assurance, or a research/software engineering role.
- Skill in designing test cases, quality-review processes, and debugging complex systems.
- Proficiency in Python and Git .
- Exceptional attention to detail and clear documentation habits.
Preferred
- Experience in AI training , model evaluation, or quality review of AI-generated work.
- A perfectionist mindset with creativity in identifying overlooked issues.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Recommended Jobs
Sous Chef
Sous Chef Help Us Grow Something Special Metro Cinema is creating a new kind of entertainment experience, bringing together private cinema, elevated dining, cocktails, wine, events, and hospitalit…
Health Insurance Sales Operations Analyst
About Gusto At Gusto, we're on a mission to grow the small business economy. We handle the hard stuff — payroll, health insurance, 401(k)s, and HR — so owners can focus on their craft and their …
Arcade Attendant
职位名称 /Job Title : 服务员 人数需求 Hiring ：3 名 / 3 Attendants 要求 / Requirements ： 会讲流利普通话和英语 / Speaking and written Fluent Mandarin and English 有相关工作经验者优先 / Prior work experience in an arc…
Busser
Role JT’s Restaurant is looking for a dependable and hardworking Busser/Server Assistant to join our front-of-house team. Located in Buffalo’s Elmwood Village, JT’s is a busy, upscale Italian…
Investment Accountant - Credit & Reporting
: Investment Accountant - Credit & Reporting Investment Controllership Full-Time New York, NY About the Corporate Controller Organization: The Controllers Organization is responsible …
Bartender-Tribeca
Job Description Job Description Butler Hospitality is operating the Food and Beverage Departments within our partner hotel Sheraton Tribeca in New York, NY. Great Location! And rapidly hiri…
Associate Director, Clinical Scientist, Ophthalmology
Build our future together: At Regeneron, we use science and innovation to develop life-changing medicines for people with serious diseases. We are seeking an Associate Director to join our Clini…
Manager, Product Management - Small Business
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can pro…
Physical Therapist - Upper East Side York Ave
Job Description Job Description Spear Physical and Occupational Therapy is seeking a qualified, passionate Physical Therapist to join the team. New graduates are welcome to apply. Therapists are …