Financial AI Evaluator (Remote, Hourly Contractor)

CNTXT AI
New York, NY

Position Summary

In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:

  • Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles

  • Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing

  • Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records

  • Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks

  • Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt

Profile Requirements

  • Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field

  • Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management

  • Ability to explain complex financial concepts clearly and accurately in writing

  • Full professional English proficiency

  • Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow

Preferred Experience

  • Prior experience with AI data training, annotation, or model evaluation

  • Familiarity with multimodal AI tools or LLM evaluation workflows

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-06-26

Recommended Jobs

Hospitality Housekeeper

Massena Hospitality LLC
Massena, NY

Job Description Job Description Benefits: Bonus based on performance Competitive salary Flexible schedule Free uniforms Benefits/Perks Competitive wages Thorough training on …

View Details
Posted 2026-06-26

Travel Histotechnologist Job

Watertown, NY

Job Overview TLC Nursing Associates, Inc. is seeking a skilled Histotechnologist for travel assignments in various healthcare facilities. This role involves processing tissue samples for micr…

View Details
Posted 2026-02-13

Organizer

Jobs to Move America
Syracuse, NY

Jobs to Move America Organizer Based in Syracuse or Onondaga, NY (hybrid) Position: Organizer Department: Northeast Position Type: Full-Time ─ Exempt Location: Syracuse or …

View Details
Posted 2026-06-06

Temporary Custodian

Oswego County Opportunities, Inc.
Phoenix, NY

Job Description Job Description Temporary Part-Time - 20 hours Per Week Grade 11 Monday to Friday - 4:00pm - 8:00pm Pay Rate: $16.00 - $20.19 Temporarily join our team here at OCO Disc…

View Details
Posted 2026-06-25

Wind Operations Site Manager-Bliss, NY

Vestas
Farmersville Station, NY

At Vestas we are powered by the mission of changing the world. And to create a sustainable future, we are building a team of motivated visionaries. Would you like to join us? This is a great …

View Details
Posted 2026-05-06

Host/Hostess

CopperTop Tavern
Vestal, NY

Come be part of our growing CopperTop Family!! Since 2007, CopperTop Tavern has been a family owned, locally operated business with locations across Central and Southern New York. CopperTop Tavern is …

View Details
Posted 2026-05-27

Customer Experience Manager at Frank's Mr. Plumber

HireAligned
Tonawanda, NY

Job Description Job Description Customer Experience Manager (CSR & Dispatch Operations) | $65,000-$72,000 + Performance Bonus | Full-Time Who We Are Frank's Mr. Plumber is looking for an experi…

View Details
Posted 2026-06-26

Data Product Manager

Moody's
New York, NY

At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are…

View Details
Posted 2026-05-12

Sales Enablement

ScaleOps
New York, NY

ScaleOps, the leader in real-time automated cloud resource management, is revolutionizing how DevOps teams manage their cloud-native application infrastructures. Backed by venture capital and softwar…

View Details
Posted 2026-06-27

Associate Director, Paid Social

IPG Mediabrands
New York, NY

Business Overview  KINESSO is the technology-driven performance marketing agency that sits at the very heart of IPG Mediabrands, providing actionable growth for both our agency partners and clien…

View Details
Posted 2026-06-24