Financial AI Evaluator (Remote, Hourly Contractor)
Position Summary
In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:
Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles
Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing
Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records
Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks
Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt
Profile Requirements
Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field
Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management
Ability to explain complex financial concepts clearly and accurately in writing
Full professional English proficiency
Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow
Preferred Experience
Prior experience with AI data training, annotation, or model evaluation
Familiarity with multimodal AI tools or LLM evaluation workflows
About CNTXT AI
CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.
Recommended Jobs
Founding Product Designer
Product Designer (3–6 Years Experience) About the Role We’re hiring a product designer who wants true ownership and the opportunity to help build something from zero to one. This is a high-i…
Senior Sales Manager - Asset Management Team
At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are…
Commodities Market Risk Manager (Risk Management) : Job Level - Associate/Analyst
Commodities Market Risk Manager - Associate/Analyst Firm Risk Management Firm Risk Management (FRM) supports Morgan Stanley to achieve its business goals by partnering with business units acros…
Cookie Production Baker
Seasonal Cookie Team Member Breads Bakery is seeking a passionate, purposeful professional to join our cookie team at our Upper East Side bakery. Breads Bakery is a New York bakery dedicated to…
Drop Ship Specialist /Business Analyst (Wal-Mart)
Job Description Job Description Salary: $70k-$75k About Us American Exchange Group is an industry leader in fashion accessory products and brand management. By facilitating distribution to …
Director of Public Safety and Health Services
Bargaining Unit: OPAP Grade: VIII Salary: Exempt Application Deadline: Open Until Filled Priority Screening: May 26, 2026 Position Overview: The Director of Public Safety is respo…
Accounts Payable Specialist (HYBRID)
Accounts Payable (AP) Specialist ?? Location: Purchase, NY (Hybrid) Overview We are seeking a detail-oriented Accounts Payable (AP) Specialist to join a fast-paced and collaborative acc…
Laborist / OB Hospitalist at Catholic Health in Buffalo, NY
Catholic Health seeks Board Certified OB-GYN's for Hospitalist/Laborist role. The role has excellent support from Neonatology, APP's, MFM, Pediatrics and Adult medical services. Catholic Health…
Skilled Trades Search Consultant
Are you our new colleague? We’re looking for a Skilled Trades Search Consultant. how you will contribute You'll be the go-to expert for connecting talented individuals in the skill…
Director of Product (Hardware, Electronics)
Mission: We’re on a mission to make Raycon the most loved electronics brand in the world where every product feels joyful, effortless, and personal. We're hiring a Director of Hardware to run Raycon…