English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

CNTXT AI
Brooklyn, NY

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-06-26

Recommended Jobs

Sales & Business Internship

Shift - Actions, Perspective, Future
New York, NY

Job Description Job Description Job Description The SHIFT Marketing Internship is an opportunity like no other. Here you will have the opportunity to learn and develop crucial skills in sales,…

View Details
Posted 2026-06-26

Cath Lab Technician

Clover Health Services
Cooperstown, NY

Job Description Job Description Clover Health Services connects you with amazing Local and Travel Registered Nurse opportunities that take you to exciting places and care settings where you can …

View Details
Posted 2026-06-26

Registered Nurse - OR Orthopedic Surgery Team Lead

Cayuga Health System
Ithaca, NY

Job Description Job Description Job Description: RN Team Lead Position Entity Cayuga Health System Position Title RN Team Lead Position Code 3004 Department OR - Ortho …

View Details
Posted 2026-06-26

Experienced Hair Stylist or Renters Wanted

La Salon Bianca LLC
Rochester, NY

Job Description Job Description Benefits: Team Work Oriented with Support In-Salon Education PTO IRA Benefits/Perks Hourly, Commission, or Rental Flexible Schedule, Choose Ho…

View Details
Posted 2026-06-25

Senior Manager Strategic Finance (FP&A)

Blue Nile
New York, NY

Blue Nile is seeking a Senior Manager Strategic Finance (Financial Planning & Analysis) to help in the daily functions of guiding the team and supporting the Director on growth and Development. The S…

View Details
Posted 2026-06-26

Principal Software Engineer (Auth0)

Okta
New York, NY

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely e…

View Details
Posted 2026-06-26

Tiffany & Co. Client Experience Director - Landmark, NYC

Tiffany & Co.
New York, NY

JOB TITLE: Director of Client Experience - The Landmark REPORTS TO: VP & General Manager, The Landmark JOB PURPOSE: The Director of Client Experience is responsible for leading and elevating…

View Details
Posted 2026-05-15

Building Superintendent/Handyman

Buffalo Biodiesel Inc
Tonawanda, NY

Job Description Job Description Buffalo Biodiesel Inc. is seeking a Building superintendent / handyman to perform the following duties: Fixing and maintaining equipment and buildings Plu…

View Details
Posted 2026-06-25

Recruiter

Family Services Inc.
Poughkeepsie, NY

Title : Talent Acquisition Manager Supervisor : HR Manager Salary : $26-$28/hr. Status : Non-exempt, 40 hours per week Location: 29 North Hamilton St. Poughkeepsie, NY 12601 Functi…

View Details
Posted 2026-06-09

Hiring Experienced Laundry Attendants w/ High Pay and Benefits!

Mountain Lake Inn Saranac Lake
Tupper Lake, NY

Job Description Job Description At Mountain Lake Inn Saranac Lake , we provide the best customer service in the hospitality industry while offering our employees stability and professional devel…

View Details
Posted 2026-06-26