English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

CNTXT AI
Brooklyn, NY

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-08-22

Recommended Jobs

Director of Sales

Digitalzone, Inc.
New York, NY

About Digitalzone: At Digitalzone, we provide data-driven lead generation solutions that help businesses grow by connecting them with the right prospects. We are seeking a results-driven Director…

View Details
Posted 2026-06-09

General Manager

The Bowery Group
New York, NY

The Bowery Group (Vic’s, Rosie’s, Shuka, Shukette, Cookshop), is a group of restaurants recognized with accolades including James Beard nominations, New York Times “Top 10 New Restaurants of 2021,” a…

View Details
Posted 2026-08-18

Wholesale Field Rep- NYC

Rag & Bone
New York, NY

About rag & bone From our origins in New York in 2002, rag & bone was founded on a belief of uncompromising ideals: a commitment to doing things the right way, not the easy way. To making things t…

View Details
Posted 2026-08-18

Hrathen Cosplay

Elantris Test Org
Schenectady, NY

Job Description Job Description Become the red armored knight HrathenBecome the red armored knight HrathenBecome the red armored knight HrathenBecome the red armored knight HrathenBecome the red …

View Details
Posted 2026-07-17

In-House Counsel (Farata Systems LLC - New York, NY)

Farata Systems LLC
New York, NY

In-House Counsel (Farata Systems LLC – New York, NY) ~Perform research and gather and analyze legal materials related to intellectual property, patents, and trademarks, particularly as regards copyri…

View Details
Posted 2026-05-27

Global Capital Markets - Infrastructure Capital Markets Associate - New York

Morgan Stanley
New York, NY

Morgan Stanley is a worldwide leader in investment banking. We are one of the top firms in mergers & acquisitions, underwriting of equity transactions, corporate debt issuance, and high-yield debt fi…

View Details
Posted 2026-07-24

Recruiter, GTM (Contract)

Dandy
New York, NY

Dandy is transforming the massive and antiquated dental industry—an industry worth over $400B. Backed by some of the world’s leading venture capital firms, we’re on an ambitious mission to simplify a…

View Details
Posted 2026-08-18

Accounts Receivable Supervisor POST NUMBER: 289470

Brentwood, NY

Accounts Receivable Supervisor – Contract Location: Brentwood, TN Schedule: Monday–Friday, 8:00 AM–5:00 PM Work Arrangement: Onsite training period; hybrid opportunity afterward based o…

View Details
Posted 2026-08-19

Hot Food Bar Cook (Lead)

Uncle Gs Management Corp.
Whitman, NY

Our marketplace is actively seeking a Chef for its Hot Food Bar! This individual will prepare our delicious dishes for our hot bar, following our signature recipes. Our new hire will have the abili…

View Details
Posted 2026-07-03

Engineering Manager

Next Ventures
New York, NY

Founding Engineer (Full Stack, Backend-Leaning) Location: New York City (5 days/week onsite) About the Opportunity We're seeking a Founding Engineer with 4-8 years of experience to join…

View Details
Posted 2026-06-30