Data Engineer - Databricks
Job description
Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
Manage FTP/SFTP file transfers between internal systems and external vendors.
Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows. 10+ years of experience in data engineering or production support within financial services or trading environments.
Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric.
Strong Python and SQL programming skills.
Experience with Bloomberg data feeds (BPIPE, TSIP,SFTP).
Recommended Jobs
ITS Technician
Duties and Responsibilities The ITS technician will be expected to perform a variety of technical work associated with the installation, removal, preventative maintenance, programming, troubleshoo…
Head Chef
Head Chef Location Hybrid work in New York, NY : Who we are: For over 20 years, Global Relay has set the standard in enterprise information archiving with industry-leading cloud archiving, surveilla…
Travel Emergency Department RN - $2,596 per week
GHR Healthcare - Travel Division is seeking a travel nurse RN ED - Emergency Department for a travel nursing job in Albany, New York. Job Description & Requirements ~ Specialty: ED - Emergency …
Travel Operating Room RN - $2,851 per week
Access Healthcare is seeking a travel nurse RN OR - Operating Room for a travel nursing job in Binghamton, New York. Job Description & Requirements ~ Specialty: OR - Operating Room ~ Discipli…
Senior Enterprise Account Executive - NY
Harness is led by technologist and entrepreneur Jyoti Bansal, founder of AppDynamics (acquired by Cisco for $3.7B). The company has raised ~$570M in Series E venture funding, is valued at $5.5B, and …
Omni Operations Coordinator
Coach is seeking an Omni Operations Coordinator in New York to manage and streamline omni-channel operations. The role involves collaboration with various teams to enhance supply chain processes and i…
Senior Plumbing and Fire Protection Engineer
We are currently hiring a Senior Plumbing and Fire Protection Engineer in our Building Engineering division at our Rochester, Syracuse, Elmira, or Ithaca, NY office. The Building Engineering Div…
CT Tech II Weekend Track
Join St. Peter's Health Partners, a leading healthcare provider in the New York State Capital District, as a CT Tech II for our Weekend Track team. Our facilities prioritize high-quality, compassionat…
Research Scientist
About Phare & R1 Phare is building healthcare's first Revenue Operating System - a platform that uses AI to make hospital billing and reimbursement effortless, accurate, and fair. We recently becam…
Junior Investment Analyst Summer Program
Junior Investment Analyst Summer Program ABS Investment Management is a ~$10 billion boutique asset manager focused on global equity long/short hedge funds, private market strategies, and speciali…