Backend Engineer, Agents

About Hebbia

The user interface for universal knowledge capture. We want every atom of information that our users need to be at their fingertips.

Designed to be generally capable– it can tackle even the most complex tasks, citing answers over any amount of sources. By showing its work, Hebbia empowers users to collaborate with AI on each step and validate responses instead of blindly trusting them. Our mission is to put capable AI in the hands of 1 billion people by 2030.

The Team

Hebbia enables leading finance and legal firms with advanced reasoning, copiloting and retrieval capabilities - unlocking meaningful insights for meaningful use cases. The Agents team builds everything from core document understanding capabilities to co-piloting experiences for matrix and deep, multi-source research. We’ve built our own agentic frameworks powered by distributed systems built for scale.

We don’t build for one-off success. We build steerable, reliable and explainable agentic systems. And we build these systems for the scale of data our customers bring to the table. Our goal is to unlock the unknowable unknown for customers all over the world.

We want to build a product that becomes indisposable to our customers and as delightful as your favorite consumer product. We move fast and build first of their kind systems.

Our team works in person 5 days a week at our SoHo office in NYC.

What we’ve built:

1. A custom multi-agent framework powering everything from deep research capabilities to copiloting interfaces paired with distributed systems infrastructure for long running agentic tasks.


2. The world’s most powerful and scalable LLM inference engine - a distributed, asynchronous DAG orchestrator capable of incorporating live graph mutations, cooperating in tandem with our LLM throughput management capabilities.


3. Elastically scaling data representation and metadata generation → powering the most effective private data retrieval systems.


4. Industry leading agents solving problems from buy side company diligence to multi billion dollar M&A.

The Role

A backend engineer at Hebbia blends expertise in systems, application layer software, and data modeling to build highly efficient software solutions. You will be responsible for leveraging the latest software and agentic solutions and integrating product experience with powerful distributed systems. You’ll help protect Hebbia’s technical edge via elegant software design, efficient data communication, and sophisticated integrations. We value engineers who move fast, hold themselves accountable to quality, and are detail-oriented.

Responsibilities

1. Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs.


2. Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume.


3. Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents.


4. Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth.

Who You Are

• Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field. A strong academic background with coursework in data structures, algorithms, and software development is preferred.


• 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on backend software engineering.


• Proficiency in building backend and API systems using technologies such as Python, Java, or Go.


• Extensive experience with cloud platforms (e.g., AWS)


• Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis


• Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders.


• Proven experience in leading software development projects and collaborating with cross-functional teams. Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.


• Enthusiasm for continuous learning and professional growth. A passion for exploring new technologies, frameworks, and software development methodologies.


• Embraces rapid prototyping with an emphasis on user feedback


• Autonomous and excited about taking ownership over major initiatives


• Bonuses:
  
  
  
  • Experience building agentic systems or LLM enabled products.
  
  
  • Frequent user of AI products, especially during the development lifecycle (i.e. Cursor, Claude Code, etc).
  
  

Compensation

The salary range for this role is $160,000 to $300,000, covering levels from junior to principal. Final leveling is determined through our assessment process, and exceptions to this range may be made for candidates with qualifications that fall outside our standard framework.

Life @ Hebbia

PTO: Unlimited

Insurance: Medical + Dental + Vision + 401K

Eats: Catered lunch daily + doordash dinner credit

Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent

Fertility benefits: $15k lifetime benefit

New hire equity grant: competitive equity package with unmatched upside potential

#LI-Onsite