Financial AI Evaluator (Remote, Hourly Contrator)

CNTXT AI
New York, NY

Position Summary

In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:

  • Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles

  • Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing

  • Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records

  • Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks

  • Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt

Profile Requirements

  • Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field

  • Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management

  • Ability to explain complex financial concepts clearly and accurately in writing

  • Full professional English proficiency

  • Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow

Preferred Experience

  • Prior experience with AI data training, annotation, or model evaluation

  • Familiarity with multimodal AI tools or LLM evaluation workflows

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-05-12

Recommended Jobs

CO PROGRAM ANALYST

US Farm Service Agency
Warsaw, NY

Summary This is a County Program Analyst position, located in the Wyoming County FSA Office, in Warsaw, New York. Major Responsibilities for this position can be found below. Learn…

View Details
Posted 2026-05-12

Director, Digital Learning and Adoption

Link Logistics
New York, NY

Link Logistics Real Estate (“Link”) is a leading operator of warehouses and business parks, specializing in last-mile logistics real estate. Established by Blackstone in 2019, the company connects co…

View Details
Posted 2026-05-09

Overheard Intern (Branded)

Doing Things Media
New York, NY

At Doing Things, our process is unique, but our purpose is clear. We connect consumers across the world through humor and happiness. Doing Things is responsible for the funniest, most shareable, and …

View Details
Posted 2026-05-12

Truck Driver CDL - A/B (Part Time)

Rescue Mission
Liverpool, NY

TRUCK DRIVER CDL-B/A (PART -TIME & WEEKENDS SHIFT)  $2500 SIGN-ON BONUS ($1000 in 90 Days & $1500 in 6 Months)   Location: Liverpool, NY. Salary: $20.50/hr. Evening Shift: 2:00 PM – 10:0…

View Details
Posted 2026-02-03

NFTA-METRO Bus Operator

Niagara Frontier Transportation Authority (NFTA)
Buffalo, NY

Start Your Career as a NFTA Metro Bus Operator — Get Paid While Obtaining Your CDL Looking for a stable, rewarding career with great benefits and guaranteed hours? Join the team and obtain your C…

View Details
Posted 2026-05-09

Cocktail Server

Ha-Weeda Tavern
Brooklyn, NY

Don’t miss out on this amazing opportunity! We’re excited to invite talented individuals like you to join our team and help us grow. Mark your calendars and come ready to show us what you can do—we c…

View Details
Posted 2026-04-15

Radiologic Technologist - CT (Community) - Syracuse, NY - CT26-05201

NavitsPartners
Auburn, NY

Job Title: Radiologic Technologist – CT (Community) Location: Syracuse, NY Duration: 14 Weeks Pay Rate: Up to $61/hr (Local) Up to $70/hr (Travel) – Based on Experience …

View Details
Posted 2026-05-11

Transportation Admin - Dispatch Operations

Tribeca Venture Partners
Buffalo, NY

ACV Operations Buffalo, NY, USA Who We Are Looking For The Transportation Admin - Dispatch Operations is responsible for supporting the Transportation department through dispatch-related ta…

View Details
Posted 2026-05-06

Senior Vice President (Leveraged Finance)

Moody's Corporation
New York, NY

At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are…

View Details
Posted 2026-03-30