English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

CNTXT AI
Brooklyn, NY

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-07-24

Recommended Jobs

Receptionist Front Desk

Salon D'Artista
Deer Park, NY

Job Description Job Description WE’RE HIRING! ✨ We’re looking for a friendly, organized, and professional Front Desk Receptionist who loves working with people and thrives in a fast-paced salon …

View Details
Posted 2026-07-23

Worker Outreach Organizer (Spanish & English Required)

United Farm Workers of America
Albany, NY

Job Description Job Description The United Farm Workers is seeking talented and motivated organizers to be part of the Farm Worker Movement in New York State and begin exciting new campaigns to …

View Details
Posted 2026-05-29

Excess Insurance Underwriter - SME Focus

Mercor
New York, NY

Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchma…

View Details
Posted 2026-07-23

Cleaner

Clean First Class LLC
Rochester, NY

Job Description Job Description Benefits: Opportunity for advancement Competitive salary Full - Time Year Round Cleaner Position Monday thru Friday - 8:30 AM - 5 PM Optional weeken…

View Details
Posted 2026-06-26

Sales Manager

RCRM - Random Talent Partners
New York, NY

Here's one: Sales Manager - Global Accounts Samsung Electronics | Worldwide About the Role Samsung Electronics is looking for a driven and experienced Sales Manager to lead and grow our g…

View Details
Posted 2026-06-18

Principal IT Systems Engineer

Regeneron
Troy, NY

Build our future together: At Regeneron, we use science and innovation to develop life-changing medicines for people with serious diseases. We are seeking a Principal or Staff IT Systems Enginee…

View Details
Posted 2026-07-23

Clinical Psychologists Needed

League Education & Treatment Center
Brooklyn, NY

If you are a Clinical Psychologist/Treatment Coordinatorwho enjoys being part of a multidisciplinary team and is seeking to enhance life for the betterment of children in our program, we would like to…

View Details
Posted 2026-05-27

Senior Tax Associate

Liberty Personnel Services, Inc.
Newburgh, NY

Job Details: Senior Tax Associate - Newburgh, NY Firm: An independent wealth management and financial advisory firm founded nearly 30 years ago that provides investment management, financia…

View Details
Posted 2026-07-24

Systems Engineer Financial Services

Fortinet
New York, NY

: We are looking for a Systems Engineer Enterprise to work closely with a Major Account Manager Enterprise in a defined territory. The Systems Engineer's main mission will be to support the sales or…

View Details
Posted 2026-07-24

Housekeeper

HouseholdStaffing
New York, NY

Job Title:   Executive Housekeeper (Full-Time) Location:   Manhattan, NY (through Summer 2026) → Manhasset, Long Island, NY (beginning Fall 2026)- Family is looking for a long term Housekeeper H…

View Details
Posted 2026-05-19