Vice President, Machine Learning Engineering - Generative AI

JPMorgan Chase Bank, N.A.
New York, NY
We are thrilled to introduce you to our team at the Chief Data and Analytics Office (CDAO) organization. As the driving force behind the firm wide adoption of Artificial Intelligence (AI) across our company, our dedicated team is responsible for overseeing data use, governance, and controls around the build, adoption and maintenance of cloud infrastructure, data and AI/ML products. With a focus on both effectiveness and responsibility, we strive to push the boundaries of innovation while ensuring ethical and sustainable practices. Join us on this exciting journey as we revolutionize the way we leverage data and analytics to shape the future of our organization.

As a Generative AI Executive Director within our CDAO organization, you will play a crucial role in ensuring the smooth operation and optimization of our LLM aided AI products. Our firm-wide team focuses on developing scalable LLM-based products and reusable back-end APIs. You will engage in close collaboration with cross-functional teams, including the ML Centre of Excellence, AI Research, Cloud Engineering, and others, to foster innovation and deliver solutions that yield a high Return-on-Investment (RoI). You will ensure that our APIs are built with scalability in mind, allowing them to efficiently handle a large number of requests without compromising performance. By designing APIs with a clear separation of concerns and well-defined interfaces, we enable other teams and developers to leverage our APIs to build their own ML products and solutions, fostering a culture of collaboration and efficiency.

Job Responsibilities
  • Combine vast data assets with cutting-edge AI, including LLMs and Multimodal LLMs
  • Bridge scientific research and software engineering, requiring expertise in both domains
  • Collaborate closely with cloud and SRE teams while leading the design and delivery of production architectures
Required qualifications, capabilities, and skills
  • PhD in a quantitative discipline, e.g. Computer Science, Mathematics, Statistics.
  • Experience in an individual contributor role in ML engineering.
  • Proven track record in building and leading teams of experienced ML engineers/scientists.
  • Solid understanding of the fundamentals of statistics, optimization, and ML theory, focusing on NLP and/or Computer Vision algorithms.
  • Hands-on experience in implementing distributed/multi-threaded/scalable applications (incl. frameworks such as Ray, Horovod, DeepSpeed, etc.).
  • Ability to understand and align with business expectations, and write clear and concise OKRs (Objectives and Key Results).
  • Experience as a \"Responsible Owner\" for ML services in enterprise environments.
  • Excellent grasp of computer science fundamentals and SDLC best practices.
  • Ability to understand business objectives and align ML problem definition.
  • Strong communication skills to effectively convey technical information and ideas at all levels, building trust with stakeholders.
Preferred qualifications, capabilities, and skills
  • Experience in designing and implementing pipelines using DAGs (e.g., Kubeflow, DVC, Ray).
  • Ability to construct batch and streaming microservices exposed as gRPC and/or GraphQL endpoints.
  • Demonstrable experience in parameter-efficient fine-tuning, model quantization, and quantization-aware fine-tuning of LLM models.
  • Hands-on knowledge of Chain-of-Thoughts, Tree-of-Thoughts, Graph-of-Thoughts prompting strategies.

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.


JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Base Pay/Salary
New York,NY $223,250.00 - $325,000.00 / year
Posted 2025-09-08

Recommended Jobs

Cashier / Sales Associate

Ross Metals
New York, NY

Job Description Job Description Benefits/Perks Competitive wages Career Growth Opportunities Fun and Energetic Environment Ongoing training Employee Discount   Job Summary W…

View Details
Posted 2025-07-28

Account Supervisor

Havas Health & You
New York, NY

Description Position at Havas Health & You Account Supervisor  The Account Supervisor (AS) is the day-to-day brand and client champion, demonstrating strong ownership of the brand keeping the f…

View Details
Posted 2025-08-06

2024 12-20 CMMC Consultant - MM/GA

VISTRADA
New York, NY

Job Description Job Description Vistrada  is seeking a highly motivated and experienced CMMC Consultant to join our growing security team and work with our clients. Description: Provides expe…

View Details
Posted 2025-07-29

Emergency Medicine Faculty - Physician - Icahn School of Medicine - New York, NY

Mount Sinai Health System
New York, NY

Description The Mount Sinai Health System is seeking an Emergency Medicine Faculty Physician to join its Emergency Medicine Department in New York. The Mount Sinai Department of Emergency Medic…

View Details
Posted 2025-09-08

Family Nurse Practitioner/ NP

Lasante Health
New York, NY

Job Description Job Description LaSante Health Center is seeking a Family Nurse Practitioner FNP to become a part of our team! You will focus on providing high quality patient care as part of a h…

View Details
Posted 2025-07-30

Lead Teacher, Childtime of Saratoga Springs

Childtime Learning Centers
Saratoga Springs, NY

Join a strong community where all we do is care-for the children and families we serve every day, as well as for our dedicated team members. Our people are our best asset. We listen and we know what …

View Details
Posted 2025-07-29

Nurse Practitioner, Per Visit - Bronx County, NY

HarmonyCares
New York, NY

Overview: HarmonyCares is one of the nation’s largest home-based primary care practices. HarmonyCares is a family of companies all dedicated to providing high-quality, coordinated health care in the …

View Details
Posted 2025-09-02

Associate Attorney - 1-5 Yrs Experience - PIP/SIU - New York, NY

Marshall Dennehey
New York, NY

Marshall Dennehey, P.C., a leading Am Law 200 civil defense law firm with over sixty years of continued service to our corporate, insurance, and individual clients, is seeking an ambitious Associate …

View Details
Posted 2025-09-01

NYS Licensed Physical Therapist

Millennium Physical Therapy
New York, NY

Job Description Job Description Millennium Physical Therapy is a Physical Therapist owned private practice seeking a licensed Physical Therapist or licensed Physical Therapy Assistant to join our…

View Details
Posted 2025-07-30

Discover Rochester: Your Next Travel Nursing Adventure Awaits!

NurseRecruiter
Rochester, NY

RN Medsurg/Tele job in Rochester, NY Embark on a rewarding travel nursing adventure in Rochester, where your expertise as a telemetry or step-down registered nurse will flourish. Experience the vibra…

View Details
Posted 2025-07-30