Senior Software Engineer, Production Engineering

Harvey
New York, NY

Why HarveyAt Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you.At Harvey, the future of professional services is being written today — and we’re just getting started.Role OverviewHarvey is building the AI platform trusted by the world’s leading law firms and enterprises. Our infrastructure is the foundation that powers every customer interaction, every model inference, and every production workload.We’re looking for a Production Engineer to help build and operate Harvey’s core compute and networking infrastructure, Kubernetes platform, workflow orchestration platform, and production infrastructure foundations. You’ll work on the systems that enable engineering teams to move quickly and operate reliable services at scale.In this role, you’ll improve the reliability, scalability, security, and efficiency of Harvey’s infrastructure platform. You’ll solve complex production challenges across compute fleet management, capacity planning, infrastructure automation, and production operations. You’ll partner closely with Product Engineering, Security, AI Infrastructure, and Platform teams to ensure our infrastructure scales with Harvey’s rapid growth.At Harvey, we value Decisiveness, Simplicity, and the belief that Job’s Not Finished. We move quickly, prioritize clarity, and continuously raise the bar for engineering excellence.What You'll DoInfrastructure Engineering & Technical LeadershipDesign, build, and operate the production infrastructure that powers Harvey’s products and AI workloads.Drive technical direction across compute infrastructure, networking, Kubernetes, workflow orchestration, and production operations.Lead complex, cross-functional technical initiatives that improve reliability, scalability, security, operational efficiency, and infrastructure cost.Partner with Product Engineering, Security, AI Infrastructure, and Platform teams to translate product and business requirements into resilient infrastructure solutions.Establish reusable patterns, tooling, and paved paths that help engineering teams ship and operate production services safely.Raise the engineering bar through thoughtful design reviews, clear technical documentation, operational rigor, and mentorship.Infrastructure Foundation & Production OperationsBuild and operate Harvey’s global compute and network infrastructure, ensuring high availability, scalability, reliability, and performance.Improve compute utilization, performance, and service availability while supporting rapidly growing AI workloads.Develop capacity models, demand forecasts, and fleet lifecycle automation to help infrastructure scale efficiently with business growth.Operate and continuously improve Harvey’s Kubernetes platform, including cluster provisioning, upgrades, networking, monitoring, reliability, performance, and operational automation.Drive infrastructure cost efficiency through capacity management, resource rightsizing, workload optimization, and utilization monitoring.Build secure infrastructure foundations, including identity and access management, network isolation, secrets management, auditing, and compliance controls.Develop scalable Infrastructure-as-Code and automation frameworks using technologies such as Terraform and Pulumi.Improve observability, monitoring, alerting, incident response, and operational readiness across the infrastructure platform.Participate in the on-call rotation, lead incident response when needed, and turn production learnings into durable engineering improvements.What You Have5+ years of software, infrastructure, site reliability, or production engineering experience.Deep experience building and operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.Experience building and operating distributed systems with strong reliability, scalability, and performance characteristics.Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.Experience designing and operating observability systems, including monitoring, logging, alerting, and incident response.Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.A track record of driving complex, cross-functional technical initiatives and influencing engineering decisions without relying on formal authority.Excellent communication skills and the ability to explain technical concepts clearly to engineering partners and other stakeholders.A systems-thinking mindset and a passion for building simple, reliable, and scalable infrastructure platforms.Nice to HaveExperience supporting AI/ML or LLM infrastructure at scale.Experience operating GPU fleets, high-performance compute infrastructure, or large-scale capacity planning.Experience with multi-cloud infrastructure or hybrid cloud environments.Experience building internal platforms or developer tooling that improves engineering velocity and production safety.Compensation$161,300 - $241,900 USDDepending on your location, an

Posted 2026-07-30

Recommended Jobs

Alternatives Risk Management, Senior Associate

Morgan Stanley
New York, NY

Morgan Stanley Investment Management (“MSIM”), together with its investment advisory affiliates, operates in 25 countries with $1.9 Tn in assets under management or supervision as of March 31, 2026. …

View Details
Posted 2026-07-09

Head Cook

HANAC, Inc.
Astoria, NY

Job Description Job Description Ravenswood Senior Center | HANAC, Inc. Astoria, NY Pay: $21.00 - $26.00 per hour (based on experience) Schedule: Full-Time (35-40 hours per week) Monda…

View Details
Posted 2026-07-23

Registered Nurse - Emergency Department - Full Time - Nights (UTICA, NY)

Mohawk Valley Health System
Utica, NY

About Mohawk Valley Health System Wynn Hospital is seeking a Registered Nurse to join our Emergency Department team! The Wynn Hospital is New York‘s newest hospital and our Emergency Department ha…

View Details
Posted 2026-06-28

Recreation Aide, Clarkson Estates

CAMBA
New York, NY

Job Description Job Description Who We Are: CAMBA is a community of staff, volunteers, clients, donors, neighbors and partners who work together to build an inclusive New York City, where all ch…

View Details
Posted 2026-06-26

Plastics Packaging Equipment Mechanic - Plant Maintenance

Novolex Corporate
Canandaigua, NY

Job Description Job Description Let’s get right to it—here’s the role in plain language Why this job matters Novolex keeps food, beverage, grocery, retail, and industrial supply chains moving …

View Details
Posted 2026-07-23

Diesel Mechanic

Firematic
Patterson, NY

Job Description Job Description Salary: $25-$35/hr DOE WHO WE ARE: Firematic is a family-owned business who has been serving those who protect us all for over 50 years! WHAT YOU'LL BE DOI…

View Details
Posted 2026-05-29

GRE Governance & Oversight Lead

JPMorgan Chase & Co.
New York, NY

Job Description JPMorgan Chase’s Chief Administrative Office (CAO) is a global powerhouse, supporting the firm’s businesses in 60 countries through a diverse range of functions including Finance &…

View Details
Posted 2026-07-23

Clinical Laboratory Technician 1

ProHEALTH Medical Management
New Hyde Park, NY

Job Description Job Description ProHEALTH is one of the largest private multi-specialty medical practices in the Northeast and has been serving the health needs of Long Island and the Greater …

View Details
Posted 2026-04-23

Senior Pre-Sales Engineer - Network

AHEAD
New York, NY

Job Description Job Description AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterpr…

View Details
Posted 2026-06-23

Front Desk Receptionist / Office Assistant

Greater New York Automobile Dealers Association
Whitestone, NY

Job Description Job Description Front Desk Receptionist/Office Assistant Job Summary: We are seeking an energetic and detail-oriented Front Desk Receptionist to be the welcoming face of o…

View Details
Posted 2026-07-17