Software Engineer, AI Gateway
About Vercel:
Vercel gives developers the tools and cloud infrastructure to build, scale, and secure a faster, more personalized web. As the team behind v0, Next.js, and AI SDK, Vercel helps customers like Ramp, Supreme, PayPal, and Under Armour build for the AI-native web.
Our mission is to enable the world to ship the best products. That starts with creating a place where everyone can do their best work. Whether you're building on our platform, supporting our customers, or shaping our story: You can just ship things.
About the Role:
As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.
- Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
- Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
- Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
- Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
- Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.
About You:
- You have at least 5+ years of relevant experience
- Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
- Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
- Experience contributing to or participating in open source projects
- Excellent communication skills and the ability to work effectively in a collaborative team environment
Benefits:
- Competitive compensation package, including equity.
- Inclusive Healthcare Package.
- Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
- Flexible Time Off.
- We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.
Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.
Recommended Jobs
Backend Software Engineer
Compensation : $170k – $250k + meaningful equity Company Overview Onyx Odds is a social sports prediction platform poised to shake up the world of sports. Onyx has seen immense growth in user …
Client Experience Coordinator (Long-Term Temporary Assignment) - Hudson Yards
At Cartier North America, we are proud to employ talent from many different backgrounds, experiences, and identities. We believe that when diversity and inclusion are fully embraced and empowered, cr…
Early Childhood Head Teacher (PreK-K)
Brooklyn Heights Montessori School (BHMS) offers a challenging and comprehensive curriculum built on the philosophy of Maria Montessori to children aged two years through eighth grade. Students wor…
Corporate Treasury, AVP/Director (COO)
We're seeking someone to join our Chief Operating Office (COO) team as a Director in Treasury to work across a variety of Firm and US Bank regulatory and internal initiatives. In the Finance div…
Relationship Banker - Canarsie Financial Center - Bilingual Spanish Required
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our …
Capital Regulatory Controllers Production - New York Associate
Department Profile The Finance Division reports to the Chief Financial Officer and consists of some 3,000 employees worldwide. Finance protects the Morgan Stanley franchise by serving as guardian …
Babysitter
Looking for a reliable live-out nanny/housekeeper to care for a 3-year-old (attends "Looking for a reliable live-in nanny/housekeeper to care for a 3-year-old (attends preschool 5 days a week for 3 ho…
Import/Export Operations Specialist
The Import/Export Operations Specialist is responsible for coordinating and managing the international shipment of goods, ensuring compliance with all applicable regulations, and maintaining efficien…
OSP Engineer
Mountain Ltd. has an opening for an OSP Engineer, working in the Mount Vernon, WA area. Since 1979, Mountain Ltd. has successfully created and supported turnkey engineering solutions for t…
IT Desktop Support Specialist
Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of …