English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)
Position Summary
This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:
Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.
Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.
LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.
This position exclusively seeks native speakers of American English born and raised in the United States.
Profile Requirements
Native speakers of American English born and raised in the United States.
Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.
Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.
Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.
Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.
Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.
Preferred Experience
Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.
Familiarity with QA workflows.
Previous experience with AI data training, annotation, or evaluation.
About CNTXT AI
CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.
Recommended Jobs
Sales & Business Internship
Job Description Job Description Job Description The SHIFT Marketing Internship is an opportunity like no other. Here you will have the opportunity to learn and develop crucial skills in sales,…
Cath Lab Technician
Job Description Job Description Clover Health Services connects you with amazing Local and Travel Registered Nurse opportunities that take you to exciting places and care settings where you can …
Registered Nurse - OR Orthopedic Surgery Team Lead
Job Description Job Description Job Description: RN Team Lead Position Entity Cayuga Health System Position Title RN Team Lead Position Code 3004 Department OR - Ortho …
Experienced Hair Stylist or Renters Wanted
Job Description Job Description Benefits: Team Work Oriented with Support In-Salon Education PTO IRA Benefits/Perks Hourly, Commission, or Rental Flexible Schedule, Choose Ho…
Senior Manager Strategic Finance (FP&A)
Blue Nile is seeking a Senior Manager Strategic Finance (Financial Planning & Analysis) to help in the daily functions of guiding the team and supporting the Director on growth and Development. The S…
Principal Software Engineer (Auth0)
Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely e…
Tiffany & Co. Client Experience Director - Landmark, NYC
JOB TITLE: Director of Client Experience - The Landmark REPORTS TO: VP & General Manager, The Landmark JOB PURPOSE: The Director of Client Experience is responsible for leading and elevating…
Building Superintendent/Handyman
Job Description Job Description Buffalo Biodiesel Inc. is seeking a Building superintendent / handyman to perform the following duties: Fixing and maintaining equipment and buildings Plu…
Recruiter
Title : Talent Acquisition Manager Supervisor : HR Manager Salary : $26-$28/hr. Status : Non-exempt, 40 hours per week Location: 29 North Hamilton St. Poughkeepsie, NY 12601 Functi…
Hiring Experienced Laundry Attendants w/ High Pay and Benefits!
Job Description Job Description At Mountain Lake Inn Saranac Lake , we provide the best customer service in the hospitality industry while offering our employees stability and professional devel…