Senior AI Engineer, Unstructured AI

Collibra
New York, NY

Responsibilities

  • Own end-to-end technical delivery of unstructured AI systems from feature prototype through stable enterprise production.
  • Write and review production-grade backend services using Python and FastAPI.
  • Build and deploy document-processing systems for large-scale unstructured data environments.
  • Integrate diverse enterprise data sources to provide context for AI features.
  • Develop and scale full-stack systems that ingest, process, and enrich documents and other unstructured content.
  • Collaborate with engineering, product, and sales teams from prototype through rollout.
  • Occasionally contribute to modern frontend development.
  • Define scope and acceptance criteria for ambiguous projects and ship end-to-end features.
  • Drive enterprise-grade AI product features, high-performance data pipelines, and context-engineering capabilities.

Requirements

  • Strong proficiency in Python for data processing, API development, and integrations.
  • Production experience with Spark or comparable big data frameworks, including tuning and debugging jobs at scale.
  • Hands-on experience with LLM-based and AI-driven enrichment such as classification, entity extraction, deduplication, and PII detection.
  • Experience shipping tested and reviewed production services rather than notebooks.
  • Experience ingesting and processing data from enterprise sources such as SharePoint, OneDrive, Salesforce, and SaaS-based knowledge bases.
  • Strong understanding of data pipelines, microservice architecture, and API design.
  • Familiarity with metadata systems, data cataloging, or document AI workflows.
  • Knowledge of model evaluation best practices and experience with search relevance.
  • Ability to independently define ambiguous problems, establish an MVP, document assumptions, and ship solutions.
  • Practical agentic engineering experience, including agent loops, guardrails, structured outputs, context management, tests, review gates, and repository conventions.
  • Bachelor’s degree or equivalent related working experience.
  • Strong communication, stakeholder-management, risk-management, and decision-making skills.
  • This position is not eligible for visa sponsorship.

Benefits

  • Hybrid role based in New York with at least two days per week in the office.
  • Flexible benefits supporting employees and their families, including health coverage and time off.
  • Flex Fund monthly stipend.
  • Pension/401k plans and equity eligibility for applicable roles.
  • Equal opportunity workplace with applicant accommodations available.
Posted 2026-08-18

Recommended Jobs

Overnight Manager, Short Term Housing Program

CAMBA
Brooklyn, NY

Who We Are: CAMBA is a community of staff, volunteers, clients, donors, neighbors and partners who work together to build an inclusive New York City, where all children and adults have access to the…

View Details
Posted 2026-07-23

Property Coverage Associate JR1726

Gallin Associates
New York, NY

PROPERTY COVERAGE ATTORNEY Insurance Coverage Practice Group Location: San Francisco preferred, see list at end of description for additional locations FULLY REMOTE   Our client, a leadi…

View Details
Posted 2026-08-18

Staff UX Researcher - AI Agents

Okta
New York, NY

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely e…

View Details
Posted 2026-08-14

Maitre D

Bark Barbecue
Brooklyn, NY

Bark Barbecue is opening a second 8,700 sq. ft. flagship destination in the heart of North Brooklyn (East Williamsburg/Bushwick) and is seeking hospitality professionals to join our opening team. Th…

View Details
Posted 2026-08-18

Lead Software Engineer - Python/React

Thomson Reuters
New York, NY

    Lead Product Engineer (Full Stack), Materia AI Lead Product Engineer (Full Stack) - Materia AI Team: Lead Product Engineers work across the end-to-end software development life cycle, applyi…

View Details
Posted 2026-04-06

Field Marketing - Associate Manager / Manager

Veeva Systems
New York, NY

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in histo…

View Details
Posted 2025-07-31

Senior Growth Manager, Cross-Border Payments (Remote)

Easiertrades Pte. Ltd.
New York, NY

A dynamic fintech company is seeking a Senior Growth Manager to expand its presence across the U.S. The ideal candidate will have over 8 years of experience in business development and enterprise sale…

View Details
Posted 2026-08-19

Senior Counsel, Legal eDiscovery - Vice President

New York, NY

Position Overview Job Title Senior Counsel, Legal eDiscovery Corporate Title Vice President Location New York City or Washington, DC Overview In this role, you will have the oppor…

View Details
Posted 2026-06-12

Sales Associate | New York City | Full Time

REISS
New York, NY

What’s the role about? As part of our team, you’ll be joining our new store opening in New York on a full-time basis, as our Sales Associate, who is responsible for providing exceptional customer s…

View Details
Posted 2026-08-03

ERM Actuary Senior

New York, NY

ERM Actuary Sr The Company is open to considering candidates in numerous locations, including New York City (NY) and Princeton (NJ). We are adding to our diverse team of experts and are loo…

View Details
Posted 2026-07-11