AI/LLM Engineer

2T Consulting
New York, NY

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Posted 2026-08-20

Recommended Jobs

Multi-Site Plant Controller - Manufacturing - Cayuga County

Genuine Search Group
Auburn, NY

Job Summary The Multi Site Plant Controller is responsible for analyzing and managing manufacturing costs, ensuring accurate financial reporting, and supporting operational decision-making. This role…

View Details
Posted 2026-05-27

Senior Building Automation Systems Specialist

Albany, NY

Position Location: This role supports our Latham, NY branch location, which serves customers throughout the greater Albany, NY, Plattsburgh, NY, Saratoga Springs, NY & Burlington, VT areas. He…

View Details
Posted 2026-08-20

Senior Electrical Engineer- Project Manager

Syska Hennessy Group
New York, NY

Job Description Job Description Senior Electrical Engineer – Project Manager Watch your work come to life in landmark projects around the world when you partner with Syska Hennessy Group! As a…

View Details
Posted 2026-08-02

Senior Project Developer

PowerFlex
New York, NY

Scope of Job PowerFlex, an EDF Renewables company, is a leading national provider of intelligent onsite energy solutions that support carbon-free electrification and transportation. The Company de…

View Details
Posted 2026-08-05

Lunch Runner (550 Madison- Bar Chimera)

Chimera
New York, NY

We are seeking to hire dynamic and experienced team members to join our award winning hospitality team as Gracious Hospitality Management expands our operations to our newest project, 550 Madison. …

View Details
Posted 2026-08-08

Tax Technology and Transformation - SAP Tax Integration - Senior

Ernst & Young
New York, NY

Location: New York, Hoboken, Iselin, Washington, Chicago, Atlanta, Dallas, Houston, San Francisco, Los Angeles At EY, we’re all in to shape your future with confidence.  We’ll help you succe…

View Details
Posted 2026-08-06

Nurse Practitioner / Physician Assistant - Geriatrics - Must Speak Chinese

CHS Recruiting
New York, NY

OPEN POSITION:  Nurse Practitioner / Physician Assistant - Geriatric Primary Care SCHEDULE:  - Full-Time - Exact Schedule Negotiable - Some Flexibility Offered - Monday to Friday - No On…

View Details
Posted 2026-08-06

Program Manager

CoinDesk
New York, NY

CoinDesk is the most trusted media, events, indices and data company for the global crypto economy. Since 2013, CoinDesk Media has led the story of the future of money and investing, illuminating the…

View Details
Posted 2026-07-17

Shaver Hall Bussers

FHC 424 5TH AVE., LLC
New York, NY

Job Description Job Description FACILITY OPERATIONS Shaver Food Hall | New York, NY Compensation: $12/Hr plus tips ABOUT SHAVER HALL In the landmark Lord & Taylor building in Midtown,…

View Details
Posted 2026-06-25

Senior Systems Engineer

GEM Technologies
New York, NY

The Company: GEM Technologies is a Managed Services Provider that delivers personalized solutions to help local businesses make the most of their technology. At GEM Technologies, we are the New York…

View Details
Posted 2026-08-20