AI Safety & Data Quality Analyst (HITL) - NYC

Description

Join the Human Intelligence Behind the World’s Leading AI – NYCAre you sharp, curious, and obsessed with the details? Welo Data is looking for Data Quality Analysts who can go beyond simple labels to help define how AI should behave in the real world.This is a Human-in-the-Loop (HITL) role where your judgment is the product. You won't just be following guidelines—you’ll be refining them, identifying failure modes, and ensuring that the next generation of AI is safe, accurate, and helpful.The Mission: Beyond AnnotationModel Evaluation: Critique AI outputs and provide structured, high-level feedback that drives model improvement.Safety Engineering: Use your 2+ years of GenAI safety experience to identify bias, risks, and edge cases.Trend Analysis: Spot patterns in how models fail and communicate these insights to stakeholders.Framework Architecture: Don’t just execute workflows—help improve the evaluation frameworks themselves.Collaborative Calibration: Partner with leads and cross-functional teams to set the gold standard for AI quality.Project DetailsJob Title: Data Quality AnalystEmployment Type: W2 Full-Time EmployeeHours: 40 hour/weekLocation: NYCBenefitsWorking on-site at our California office comes with premium benefits designed to let you focus on your best work:Free Gourmet Dining: Chef-prepared breakfast, lunch, and dinner with global cuisines.Endless Snacks: Micro-kitchens stocked with premium coffee, beverages, and healthy treats.Campus Life: Access to unique features like rooftop nature parks and modern collaborative spaces.Commuter Ease: Free transport, shuttles, and bike-to-work perks.Full Security: Comprehensive Medical, Dental, and Vision + 401(k) and HSA.Time Off: 15 days of combined Paid Sick/Holiday time + major holidays.Who We’re Looking ForEducation: A University degree combined with native-level language proficiency.Writing Mastery: 1–2 years of professional writing experience. You must be able to articulate complex "why" justifications clearly.AI Safety Expertise: 2+ years of experience specifically focusing on Safety & Trust in GenAI data delivery.Critical Thinking: The ability to navigate "grey areas" and make sound judgment calls when guidelines are ambiguous.Technical Curiosity: You’re naturally interested in how LLMs behave and aren't afraid to speak up when something feels "off."