Financial AI Evaluator (Remote, Hourly Contractor)

CNTXT AI
New York, NY

Position Summary

In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:

  • Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles

  • Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing

  • Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records

  • Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks

  • Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt

Profile Requirements

  • Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field

  • Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management

  • Ability to explain complex financial concepts clearly and accurately in writing

  • Full professional English proficiency

  • Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow

Preferred Experience

  • Prior experience with AI data training, annotation, or model evaluation

  • Familiarity with multimodal AI tools or LLM evaluation workflows

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Posted 2026-05-27

Recommended Jobs

Founding Product Designer

Next Ventures
New York, NY

Product Designer (3–6 Years Experience) About the Role We’re hiring a product designer who wants true ownership and the opportunity to help build something from zero to one. This is a high-i…

View Details
Posted 2026-05-24

Senior Sales Manager - Asset Management Team

Moody's
New York, NY

At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are…

View Details
Posted 2026-05-12

Commodities Market Risk Manager (Risk Management) : Job Level - Associate/Analyst

Morgan Stanley
New York, NY

Commodities Market Risk Manager - Associate/Analyst Firm Risk Management Firm Risk Management (FRM) supports Morgan Stanley to achieve its business goals by partnering with business units acros…

View Details
Posted 2026-04-06

Cookie Production Baker

Breads Bakery - Union Square
New York, NY

Seasonal Cookie Team Member   Breads Bakery is seeking a passionate, purposeful professional to join our cookie team at our  Upper East Side   bakery. Breads Bakery is a New York bakery dedicated to…

View Details
Posted 2026-05-18

Drop Ship Specialist /Business Analyst (Wal-Mart)

American Exchange Group
New York, NY

Job Description Job Description Salary: $70k-$75k About Us American Exchange Group is an industry leader in fashion accessory products and brand management. By facilitating distribution to …

View Details
Posted 2026-04-11

Director of Public Safety and Health Services

SUNY Ulster
Stone Ridge, NY

Bargaining Unit: OPAP Grade: VIII Salary: Exempt Application Deadline: Open Until Filled Priority Screening: May 26, 2026   Position Overview: The Director of Public Safety is respo…

View Details
Posted 2026-05-12

Accounts Payable Specialist (HYBRID)

Aston Carter
Rye Brook, NY

Accounts Payable (AP) Specialist ?? Location: Purchase, NY (Hybrid) Overview We are seeking a detail-oriented Accounts Payable (AP) Specialist to join a fast-paced and collaborative acc…

View Details
Posted 2026-05-24

Laborist / OB Hospitalist at Catholic Health in Buffalo, NY

Catholic Health System
Buffalo, NY

Catholic Health seeks Board Certified OB-GYN's for Hospitalist/Laborist role.   The role has excellent support from Neonatology, APP's, MFM, Pediatrics and Adult medical services. Catholic Health…

View Details
Posted 2026-05-27

Skilled Trades Search Consultant

Melville, NY

Are you our new colleague? We’re looking for a Skilled Trades Search Consultant. how you will contribute You'll be the go-to expert for connecting talented individuals in the skill…

View Details
Posted 2026-05-18

Director of Product (Hardware, Electronics)

Raycon, Inc.
New York, NY

Mission:  We’re on a mission to make Raycon the most loved electronics brand in the world where every product feels joyful, effortless, and personal. We're hiring a Director of Hardware to run Raycon…

View Details
Posted 2026-05-27