English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)
Position Summary
This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:
Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.
Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.
LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.
This position exclusively seeks native speakers of American English born and raised in the United States.
Profile Requirements
Native speakers of American English born and raised in the United States.
Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.
Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.
Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.
Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.
Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.
Preferred Experience
Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.
Familiarity with QA workflows.
Previous experience with AI data training, annotation, or evaluation.
About CNTXT AI
CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.
Recommended Jobs
Internal Auditor I (DOT Internal Auditor I)
: COMPETITIVE CONTRACTUAL State Highway Administration Internal Auditor I (DOT Internal Auditor I) Grade 15 (7161) SP#24-17-03 YOU MUST APPLY ONLINE TO BE CONSIDERED FOR THIS POSITION THE RECON…
Senior Python Developer
We are working with an expanding Hedge Fund/Asset Management firm that is building out there technology team from scratch. The team is developing application across front, middle and back office and a…
Radiologist (Physician)
Overview Ansible Government Solutions, LLC (Ansible) is currently recruiting Radiologists to provide onsite services to eligible beneficiaries of the James J. Peters VA Medical Center located at 1…
Manager, Commerce Search
Business Overview KINESSO is the technology-driven performance marketing agency providing actionable growth for both our agency partners and clients. We turn 'action' into 'outcome' for our client…
Blockchain Test Engineer
Blockchain Test Engineer (Smart Contracts + DApps + QA Automation) Job Summary We are looking for a skilled Blockchain Test Engineer with strong experience in software testing and blockc…
Warehouse Associate
Who We Are Roma Tile & Marble is a family-owned Syracuse company with over 65 years of experience delivering high-quality stone and tile craftsmanship. Operating out of our 50,000+ square-foot sho…
Marvin's Camp Counselor
JOB SUMMARY Marvin’s is a division of campers ages 6 – 21 with Special Needs. The main object of a camp counselor is to ensure the safety, well-being and over all camp experience of your campers is…
Sales Associate
Sales Associate Location: New York City, NY - Upper West Side Job Type: Part Time Compensation: $20 per hour Schedule/Availability: Must be available and able to work weekends …
Travel Nurse RN - Progressive Care Unit - $3,629 per week in Rochester, NY
Registered Nurse (RN) | Progressive Care Unit Location: Rochester, NY Agency: KPG Healthcare Pay: $3,629 per week Shift Information: Days - 3 days x 12 hours Contract Duration:…
Co-Founder & CEO - AI Proposal Intelligence for AEC
The Opportunity FutureSight is seeking a Co-Founder & CEO to lead BidOps, an AI-native proposal-orchestration platform for architecture, engineering, and construction (AEC) firms, currently bein…