Financial AI Evaluator (Remote, Hourly Contractor)

CNTXT AI
New York, NY

Position Summary

In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:

  • Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles

  • Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing

  • Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records

  • Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks

  • Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt

Profile Requirements

  • Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field

  • Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management

  • Ability to explain complex financial concepts clearly and accurately in writing

  • Full professional English proficiency

  • Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow

Preferred Experience

  • Prior experience with AI data training, annotation, or model evaluation

  • Familiarity with multimodal AI tools or LLM evaluation workflows

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-07-24

Recommended Jobs

Travel Labor and Delivery Registered Nurse - $2,358 per week

HonorVet Technologies
Newark, NY

HonorVet Technologies is seeking a travel nurse RN Labor and Delivery for a travel nursing job in Newark, New York. Job Description & Requirements ~ Specialty: Labor and Delivery ~ Discipline…

View Details
Posted 2026-07-24

Laborer (Quarry)

Maine Drilling & Blasting Inc
Rochester, NY

Job Description Job Description Come work with the best! At Maine Drilling & Blasting we work with the unity of family and the determination of business owners. As a majority Employee Owned compa…

View Details
Posted 2026-06-26

Sous Chef

La Pecora Bianca - Bryant Park
New York, NY

Job Details We are seeking a Sous Chef to join our growing team! La Pecora Bianca, the fastest growing Italian restaurant group in NYC with 9 restaurants currently under operation in Manhattan and…

View Details
Posted 2026-07-17

Desktop Support Analyst (Hedge Fund)

Oakridge Staffing
New York, NY

Top global alternative asset firm is looking to hire a desktop support person into their Infrastructure team. Responsibilities: ~Provide primary end-user support by responding to and addressing all …

View Details
Posted 2026-05-27

Craftsman / Carpenter - Remodeling Experience

TruBlue Home Service Ally
Yorktown, NY

TruBlue Home Services is seeking full-time professional craftsman to serve our customers in the Hill Country area. Our Mission is to provide home remodeling and other home maintenance work to the com…

View Details
Posted 2026-05-06

Host

Hotel Chelsea
New York, NY

We are looking for a BREAKFAST and LUNCH HOST with 8AM availability.  We are looking for experienced hospitality professionals to join our team. We are currently focused on candidates wtih full-tim…

View Details
Posted 2026-07-24

Customer Service / Student Services Representative (Part-Time)

Hire Frontier
Bronx County, NY

Customer Service / Student Services Representative (Part-Time) Job Title: Customer Service / Student Services Representative (Part-Time) Employment Type: Part-Time Location: On-Site Schedule:…

View Details
Posted 2026-07-17

Real Assets Sustainability - Investment Management - Off-Cycle Intern

Morgan Stanley
New York, NY

Morgan Stanley Investment Management (“MSIM”), together with its investment advisory affiliates, has more than 1,300 investment professionals around the world and $1.9 trillion in assets under manage…

View Details
Posted 2026-06-21

PowerPoint Coordinator

Careerscape
New York, NY

Our client is seeking a PowerPoint Coordinator to design, build, and polish professional presentations for executives and client-facing teams. You'll turn raw content and data into clean, on-brand, v…

View Details
Posted 2026-06-15

Inventory Market Specialist

New York, NY

#WeAreParamount on a mission to unleash the power of content… you in? We’ve got the brands, we’ve got the stars, we’ve got the power to achieve our mission to entertain the planet – now all we’re …

View Details
Posted 2026-06-20