Sr. Data Engineer
Job Description
Insight Global is seeking a Senior Data Engineer to join our client, a rapidly growing re/insurance organization modernizing their data ecosystem. This is role is on a high-performing data engineering team supporting core data architecture, data applications, and internal/external API data flows.
This engineer must be able to work independently, own end-to-end solutions, and operate with low oversight. The environment is highly collaborative, low-ego, and fully AI-enabled-engineers are encouraged to leverage AI tools before escalating questions.
Day to Day will include:
-
Build, maintain, and optimize data pipelines that support applications, APIs, and reporting environments.
-
Migrate existing pipelines (currently using Click Replicate and proprietary solutions) into modern, open-source-driven architectures.
-
Move and process data into the Snowflake data warehouse and manage CI/CD pipeline improvements.
-
Work with streaming and CDC concepts involving Kafka, Kafka Connect, Debezium (or similar tools).
-
Implement and manage transformations using DBT (SQL + configuration files).
-
Support medallion/layered data architecture (bronze, silver, gold), staging layers, and data marts.
-
Collaborate with backend architecture teams on data application development and API data flows.
-
Troubleshoot, refactor, and optimize data models and processing workflows.Use AI tools (e.g., Claude, Copilot) to accelerate problem-solving and development.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
Skills and Requirements
-
5+ years expeirnece within data engineering
Strong SQL experience
-
Hands-on experience developing and supporting production data pipelines
-
Experience with or understanding of:
-
Kafka / Kafka Connect / CDC concepts (Debezium or similar)
-Snowflake or other cloud data warehousing platforms
-Medallion/layered data architecture principles
-CI/CD and modern data engineering workflows
-
DBT experience (critical from day one) Python
PostgreSQL experience
Experience with Azure Blob Storage
Familiarity with lakehouse concepts (Databricks not required)
Broader cloud or infrastructure experience
Recommended Jobs
Senior Python Developer - Counterparty Credit Risk Application Developer - Vice President
The Analytical Calculation Engine (ACE) Development Team is a group within Citi Financial Risk Technology, responsible for developing and implementing the applications used for derivatives credit ris…
Intern - Creative
Our Summer Internship Program An internship with us gives you the opportunity to work side by side with passionate problem solvers on powerful and fulfilling work. Our collaborative culture inspir…
Sr Controls Engineer
: Country: United States of America Location: CAN01: Carrier-Syracuse, NY 6304 Carrier Parkway , East Syracuse, NY, 13057 USA ABOUT US: Carrier Global Corporation, global leader in intell…
Retail Store Assistant Manager
The UPS Store is a network of individually owned and operated franchised service centers specializing in small business solutions. The Assistant Store Manager helps the Store Manager run the day-to…
Job Opportunity: REGISTERED NURSE
REGISTERED NURSE Work Days: Monday - Friday Hours Per Week: 40 Weeks Per Year: 34 Pay Status and Classification: Non-exempt, regular full-time. This is a 10-month position…
DevRel NYC
Location: New York City Employment Type: Full time Location Type: Hybrid Department: Business Development About Us Out client first parallelized layer 1 blockchain. By re-w…
Director of Payroll Operations
Kforce's client, a long-standing, Queens, NY based service firm seeks a Director of Payroll Operations. This role will work a hybrid schedule after the in-office training period. This is a newly creat…
Business Service Officer
Morgan Stanley Business Service Officer Job Description POSITION SUMMARY Business Service Officers (BSO) are responsible for shaping the future of service by modernizing our client …
Senior Software Engineer (Full-Stack)
As a Senior Software Engineer at Lithos, you’ll work directly with our Head of Engineering to build the operating system for one of the largest carbon dioxide removal efforts in history. How does so…
Area Sales Manager
As a Digital Sales Consultant for Capital One Auto Finance, you will partner closely with a defined set of Automobile Dealerships, providing consultative guidance to help each dealer achieve its oper…