English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

CNTXT AI
Brooklyn, NY

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-05-27

Recommended Jobs

Internal Auditor I (DOT Internal Auditor I)

Maryland Department of Transportation
Mount Vernon, NY

: COMPETITIVE CONTRACTUAL State Highway Administration Internal Auditor I (DOT Internal Auditor I) Grade 15 (7161) SP#24-17-03 YOU MUST APPLY ONLINE TO BE CONSIDERED FOR THIS POSITION THE RECON…

View Details
Posted 2026-05-24

Senior Python Developer

Oakridge Staffing
New York, NY

We are working with an expanding Hedge Fund/Asset Management firm that is building out there technology team from scratch. The team is developing application across front, middle and back office and a…

View Details
Posted 2026-05-27

Radiologist (Physician)

Ansible Government Solutions
Bronx, NY

Overview Ansible Government Solutions, LLC (Ansible) is currently recruiting Radiologists to provide onsite services to eligible beneficiaries of the James J. Peters VA Medical Center located at 1…

View Details
Posted 2026-02-24

Manager, Commerce Search

IPG Mediabrands
New York, NY

Business Overview  KINESSO is the technology-driven performance marketing agency providing actionable growth for both our agency partners and clients. We turn 'action' into 'outcome' for our client…

View Details
Posted 2026-05-12

Blockchain Test Engineer

Purple Drive
New York, NY

Blockchain Test Engineer (Smart Contracts + DApps + QA Automation) Job Summary We are looking for a skilled Blockchain Test Engineer with strong experience in software testing and blockc…

View Details
Posted 2026-05-12

Warehouse Associate

HR One
Syracuse, NY

Who We Are Roma Tile & Marble is a family-owned Syracuse company with over 65 years of experience delivering high-quality stone and tile craftsmanship. Operating out of our 50,000+ square-foot sho…

View Details
Posted 2026-05-27

Marvin's Camp Counselor

Jewish Community Center Of Staten Island
Staten Island, NY

JOB SUMMARY Marvin’s is a division of campers ages 6 – 21 with Special Needs. The main object of a camp counselor is to ensure the safety, well-being and over all camp experience of your campers is…

View Details
Posted 2026-05-12

Sales Associate

Skin Laundry
New York, NY

  Sales Associate Location: New York City, NY - Upper West Side Job Type: Part Time Compensation: $20 per hour Schedule/Availability: Must be available and able to work weekends …

View Details
Posted 2026-05-24

Travel Nurse RN - Progressive Care Unit - $3,629 per week in Rochester, NY

TravelNurseSource
Rochester, NY

Registered Nurse (RN) | Progressive Care Unit Location: Rochester, NY Agency: KPG Healthcare Pay: $3,629 per week Shift Information: Days - 3 days x 12 hours Contract Duration:…

View Details
Posted 2026-05-27

Co-Founder & CEO - AI Proposal Intelligence for AEC

FutureSight
New York, NY

The Opportunity FutureSight is seeking a Co-Founder & CEO to lead BidOps, an AI-native proposal-orchestration platform for architecture, engineering, and construction (AEC) firms, currently bein…

View Details
Posted 2026-05-06