Sr. Data Engineer

Insight Global
New York, NY

Job Description

Insight Global is seeking a Senior Data Engineer to join our client, a rapidly growing re/insurance organization modernizing their data ecosystem. This is role is on a high-performing data engineering team supporting core data architecture, data applications, and internal/external API data flows.

This engineer must be able to work independently, own end-to-end solutions, and operate with low oversight. The environment is highly collaborative, low-ego, and fully AI-enabled-engineers are encouraged to leverage AI tools before escalating questions.

Day to Day will include:

  • Build, maintain, and optimize data pipelines that support applications, APIs, and reporting environments.

  • Migrate existing pipelines (currently using Click Replicate and proprietary solutions) into modern, open-source-driven architectures.

  • Move and process data into the Snowflake data warehouse and manage CI/CD pipeline improvements.

  • Work with streaming and CDC concepts involving Kafka, Kafka Connect, Debezium (or similar tools).

  • Implement and manage transformations using DBT (SQL + configuration files).

  • Support medallion/layered data architecture (bronze, silver, gold), staging layers, and data marts.

  • Collaborate with backend architecture teams on data application development and API data flows.

  • Troubleshoot, refactor, and optimize data models and processing workflows.Use AI tools (e.g., Claude, Copilot) to accelerate problem-solving and development.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

  • 5+ years expeirnece within data engineering

Strong SQL experience

  • Hands-on experience developing and supporting production data pipelines

  • Experience with or understanding of:

  • Kafka / Kafka Connect / CDC concepts (Debezium or similar)

-Snowflake or other cloud data warehousing platforms

-Medallion/layered data architecture principles

-CI/CD and modern data engineering workflows

  • DBT experience (critical from day one) Python

PostgreSQL experience

Experience with Azure Blob Storage

Familiarity with lakehouse concepts (Databricks not required)

Broader cloud or infrastructure experience

Posted 2026-03-09

Recommended Jobs

Senior Python Developer - Counterparty Credit Risk Application Developer - Vice President

Citi
New York, NY

The Analytical Calculation Engine (ACE) Development Team is a group within Citi Financial Risk Technology, responsible for developing and implementing the applications used for derivatives credit ris…

View Details
Posted 2026-02-15

Intern - Creative

New York, NY

Our Summer Internship Program An internship with us gives you the opportunity to work side by side with passionate problem solvers on powerful and fulfilling work. Our collaborative culture inspir…

View Details
Posted 2026-03-09

Sr Controls Engineer

Carrier
East Syracuse, NY

: Country: United States of America Location: CAN01: Carrier-Syracuse, NY 6304 Carrier Parkway , East Syracuse, NY, 13057 USA ABOUT US: Carrier Global Corporation, global leader in intell…

View Details
Posted 2026-03-12

Retail Store Assistant Manager

The UPS Store #0647
New York, NY

The UPS Store is a network of individually owned and operated franchised service centers specializing in small business solutions. The Assistant Store Manager helps the Store Manager run the day-to…

View Details
Posted 2025-08-23

Job Opportunity: REGISTERED NURSE

Schenectady, NY

REGISTERED NURSE Work Days: Monday - Friday Hours Per Week: 40 Weeks Per Year: 34 Pay Status and Classification: Non-exempt, regular full-time. This is a 10-month position…

View Details
Posted 2026-01-30

DevRel NYC

TechChain Talent
New York, NY

Location:  New York City Employment Type:  Full time Location Type:  Hybrid Department:  Business Development About Us Out client first parallelized layer 1 blockchain. By re-w…

View Details
Posted 2026-02-10

Director of Payroll Operations

Queens County, NY

Kforce's client, a long-standing, Queens, NY based service firm seeks a Director of Payroll Operations. This role will work a hybrid schedule after the in-office training period. This is a newly creat…

View Details
Posted 2026-01-26

Business Service Officer

Morgan Stanley
New York, NY

Morgan Stanley Business Service Officer Job Description POSITION SUMMARY Business Service Officers (BSO) are responsible for shaping the future of service by modernizing our client …

View Details
Posted 2026-01-30

Senior Software Engineer (Full-Stack)

Lithos
New York, NY

As a Senior Software Engineer at Lithos, you’ll work directly with our Head of Engineering to build the operating system for one of the largest carbon dioxide removal efforts in history. How does so…

View Details
Posted 2025-11-12

Area Sales Manager

Capital One
Syracuse, NY

As a Digital Sales Consultant for Capital One Auto Finance, you will partner closely with a defined set of Automobile Dealerships, providing consultative guidance to help each dealer achieve its oper…

View Details
Posted 2026-03-09