Back-End Engineering (Systems)
We’re hiring a Member of Technical Staff (Back-End / Systems) to join a small, deeply technical team building a next-generation platform for large-scale AI and LLM systems.
This role is ideal for an engineer who enjoys working close to the metal, cares deeply about performance and correctness, and wants to build infrastructure that other engineers rely on in production. Much of the work is open source and highly visible.
What You’ll Be Working On
You’ll help build and evolve a modern LLMOps and AI systems platform used by teams ranging from early-stage startups to large enterprises. The platform focuses on:
- Unified access to LLM providers via low-latency APIs
- Observability for AI systems (metrics, traces, debugging tools)
- Optimization pipelines for cost, latency, and quality
- Evaluation frameworks for individual inferences and end-to-end workflows
- Experimentation infrastructure (A/B testing, fallbacks, rollouts)
On top of this platform, the team is developing an automated AI engineering system that collaborates with engineers to analyze large volumes of inference data, recommend improvements, run experiments, and prevent regressions — all with full transparency and control.
Requirements
Core Requirements
- Strong background in back-end and systems engineering
- Experience building production systems that prioritize performance, reliability, and correctness
- Proficiency with systems programming languages such as Rust, C/C++, or Zig
- Comfort owning large technical projects from inception to deployment
Recommended Jobs
Global FP&A & Business Performance Lead
A leading consulting firm is seeking a Business Performance Manager to enhance its financial and budgeting frameworks. The role involves managing financial accounting, budget planning, and developing…
Head of Power System Studies, Powertech USA
Powertech USA is a Boston-based, wholly-owned subsidiary of Powertech Labs Inc (Powertech). Powertech is a cleantech company with the mission of being a trusted innovation partner providing consulting…
Sommelier
The Dinex Group, restaurant group for Chef Daniel Boulud, seeks experienced Sommelier for its flagship, RESTAURANT DANIEL. The Sommelier will be responsible for wine service on the floor, maintain…
Senior Caregiver
Looking for a male preferably Hungarian speaking gentleman to be a companion for my father living in Brooklyn. No food preparation, no house cleaning, only social interaction. Family members live in h…
Fabric R&D Assistant
Our Company: Originally founded in 1975, BCI has continually evolved to become a leader in the women's fashion industry. Launching initially with CHAUS and private label lines and then expanding int…
Physical Therapist
Join St. Peter's Health Partners, a distinguished leader in healthcare within the New York State Capital District. We're seeking a skilled Physical Therapist who is dedicated to advancing health and w…
Trades Generalist - 40929
NY HELP No Agency Health, Department of - Veterans Home at Batavia Title Trades Generalist - 40929 Occupational Category Skilled Craft, Apprenticeship, Maintenance Salary Grade 12…
Receptionist
Position: Receptionist Reports to: President Cannon Industries A global company with headquarters in Rochester, New York, Cannon Industries has grown to become one of the leading sheet m…
Pre-K Learning Specialist (Special Education Teacher)
Why Harlem Gems Pre-K? At Harlem Children’s Zone (HCZ), our mission is to break the cycle of intergenerational poverty and unlock new possibilities for our children, families, and communities. As t…
Senior Designer
Pay Range $18.81 - $27.79 Purpose Floor & Decor Sr. Designer leads our design team and provide a seamless start to finish consultative design service that builds lasting relationships and bran…