Financial AI Evaluator (Remote, Hourly Contrator)
Position Summary
In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:
Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles
Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing
Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records
Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks
Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt
Profile Requirements
Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field
Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management
Ability to explain complex financial concepts clearly and accurately in writing
Full professional English proficiency
Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow
Preferred Experience
Prior experience with AI data training, annotation, or model evaluation
Familiarity with multimodal AI tools or LLM evaluation workflows
About CNTXT AI
CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.
Recommended Jobs
CO PROGRAM ANALYST
Summary This is a County Program Analyst position, located in the Wyoming County FSA Office, in Warsaw, New York. Major Responsibilities for this position can be found below. Learn…
Director, Digital Learning and Adoption
Link Logistics Real Estate (“Link”) is a leading operator of warehouses and business parks, specializing in last-mile logistics real estate. Established by Blackstone in 2019, the company connects co…
Overheard Intern (Branded)
At Doing Things, our process is unique, but our purpose is clear. We connect consumers across the world through humor and happiness. Doing Things is responsible for the funniest, most shareable, and …
Truck Driver CDL - A/B (Part Time)
TRUCK DRIVER CDL-B/A (PART -TIME & WEEKENDS SHIFT) $2500 SIGN-ON BONUS ($1000 in 90 Days & $1500 in 6 Months) Location: Liverpool, NY. Salary: $20.50/hr. Evening Shift: 2:00 PM – 10:0…
NFTA-METRO Bus Operator
Start Your Career as a NFTA Metro Bus Operator — Get Paid While Obtaining Your CDL Looking for a stable, rewarding career with great benefits and guaranteed hours? Join the team and obtain your C…
Cocktail Server
Don’t miss out on this amazing opportunity! We’re excited to invite talented individuals like you to join our team and help us grow. Mark your calendars and come ready to show us what you can do—we c…
Radiologic Technologist - CT (Community) - Syracuse, NY - CT26-05201
Job Title: Radiologic Technologist – CT (Community) Location: Syracuse, NY Duration: 14 Weeks Pay Rate: Up to $61/hr (Local) Up to $70/hr (Travel) – Based on Experience …
Transportation Admin - Dispatch Operations
ACV Operations Buffalo, NY, USA Who We Are Looking For The Transportation Admin - Dispatch Operations is responsible for supporting the Transportation department through dispatch-related ta…
Senior Vice President (Leveraged Finance)
At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are…