Backend Engineer, Agent Collaboration Platform
About Hebbia
The user interface for universal knowledge capture. We want every atom of information that our users need to be at their fingertips.
Designed to be generally capable– it can tackle even the most complex tasks, citing answers over any amount of sources. By showing its work, Hebbia empowers users to collaborate with AI on each step and validate responses instead of blindly trusting them. Our mission is to put capable AI in the hands of 1 billion people by 2030.
The Team
The Agent Collaboration platform team at Hebbia builds the interactive scratch-pad, analysis, and content creation tools for Agents. Our flagship product, Matrix, is a generative spreadsheet that leverages our ISD process to coordinate complex agentic workflows across thousands of documents. We pair a simple, elegant interface—where users can kick off complex multistep document workflows—with a real-time, high-throughput LLM execution engine capable of processing the equivalent of 100 Harry Potter novels per second. Together, we turn massive, unstructured document repositories into seamless, actionable intelligence.
Our team works in person 5 days a week at our SoHo office in NYC.
The Role
A backend engineer at Hebbia blends expertise in systems, application layer software, and data modeling to build highly efficient software solutions. You will be responsible for leveraging the latest software and agentic solutions and integrating product experience with powerful distributed systems. You’ll help protect Hebbia’s technical edge via elegant software design, efficient data communication, and sophisticated integrations. We value engineers who move fast, hold themselves accountable to quality, and are detail-oriented.
Responsibilities
- Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs.
- Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume.
- Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents.
- Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth.
Who You Are
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field. A strong academic background with coursework in data structures, algorithms, and software development is preferred.
- 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on backend software engineering.
- Proficiency in building backend and API systems using technologies such as Python, Java, or Go.
- Extensive experience with cloud platforms (e.g., AWS)
- Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
- Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders.
- Proven experience in leading software development projects and collaborating with cross-functional teams. Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.
- Enthusiasm for continuous learning and professional growth. A passion for exploring new technologies, frameworks, and software development methodologies.
- Embraces rapid prototyping with an emphasis on user feedback
- Autonomous and excited about taking ownership over major initiatives
- Bonuses:
- Experience building agentic systems or LLM enabled products.
- Frequent user of AI products, especially during the development lifecycle (i.e. Cursor, Claude Code, etc).
Compensation
The salary range for this role is $160,000 to $300,000, covering levels from junior to principal. Final leveling is determined through our assessment process, and exceptions to this range may be made for candidates with qualifications that fall outside our standard framework.
Life @ Hebbia
PTO: Unlimited
Insurance: Medical + Dental + Vision + 401K
Eats: Catered lunch daily + doordash dinner credit
Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent
Fertility benefits: $15k lifetime benefit
New hire equity grant: competitive equity package with unmatched upside potential
#LI-Onsite
Recommended Jobs
Java Software Engineer - Remote (Req. #733)
Founded in 1994, Mindex is a software development company with a rich history of demonstrated software and product development success. Our three divisions – Cloud, SchoolTool, and Software Developme…
Special Education Teacher - Bronx
Summary ...Summary Job Description Job Description Special Education SETSS Teacher (K-12) - Bronx We are seeking a New York State certified Special Education... ...and implement engaging less…
Manager of CVM Production Implementation
Tiffany & Co. seeks a Manager of CVM Production Implementation in New York to oversee the global production, rollout, and inventory management of CVM assets. This role requires strategic leadership to…
HR Coordinator
Job Responsibilities: Respond to HR-related questions via email, phone, and in-person. Process transactions in HR systems like Workday and Cisive. Coordinate onboarding and offboarding, incl…
Web designer
Job Description The Mayor's Office of Contract Services (MOCS) is a New York City oversight and service agency that manages procurement citywide, from planning and release of agency solicitatio…
Assistant Professor in Health and Wellness
*Category:*: Faculty *Subscribe:*: *Department:*: Decker College of Nursing and Health Sciences *Locations:*: Binghamton, NY *Posted:*: May 12, 2025 *Closes:*: Open Until Filled *Type:*: Fu…
Software Engineer, C++
Aquatic was founded with a shared passion for tackling some of the most complex challenges in one of the world’s most competitive arenas—global financial markets. From the very beginning, we have bee…
Assistant Youth Facilitator - CAMBA After School
Who We Are: CAMBA is a community of staff, volunteers, clients, donors, neighbors and partners who work together to build an inclusive New York City, where all children and adults have access to the…
Patient Service Representative
Job Description: Artificial Intelligence; Advanced Technology; The very best in patient care. With decades of expertise, we are Leading Radiology Forward . With dynamic cross-training and advanceme…
Assistant or Associate Professor - Department of Physical Therapy (DPT), Brookdale Campus
Assistant or Associate Professor - Department of Physical Therapy (DPT), Brookdale Campus **FACULTY VACANCY ANNOUNCEMENT** The Department of Physical Therapy at Hunter College, The City University of …