Senior data engineer
Title: Data Engineer
Location: New York,Dallas,Chicago (Hybrid)
We are seeking an experienced Data Engineer to design and maintain scalable data pipelines in Databricks. The role involves end-to-end ownership of data workflows, from ingestion to production, ensuring performance, quality, and reliability.
Responsibilities
- Build and optimize pipelines in Databricks (PySpark, SQL, Delta Lake).
- Ingest data from databases, APIs, PDFs, Excel, flat files, and web scraping.
- Implement data quality checks, validation, and testing frameworks.
- Deploy, monitor, and optimize pipelines in Databricks/AWS.
- Collaborate with data science/analytics teams and document data processes.
Qualifications
- 5+ years of Data Engineering experience.
- Hands-on expertise in Databricks (PySpark, SQL, Delta Lake).
- Strong experience with structured & unstructured data.
- Knowledge of data quality/testing tools (Great Expectations, Deequ, dbt tests).
- Proven ability to optimize large-scale Spark/Databricks workloads.
Email : [email protected]
Job Types: Full-time, Contract
Work Location: In person
Recommended Jobs
Staff Frontend Engineer
Staff Frontend Engineer - Global Trade Comment Network Location: New York City (Hybrid) Compensation: $180K - $250K We are building the global trade comment network , a protocol design…
Sr. Coordinator, Associate Communications- PVH Corp.
About Us: We are brand builders who focus our passion and creativity to build Calvin Klein and TOMMY HILFIGER into the most desirable lifestyle brands in the world and at the same time position …
Linux technical support analyst
Linux Technical Support Analyst Req number: R6488 Employment type: Full time Worksite flexibility: Remote Who we are CAI is a global technology services firm w…
Physical Therapist - Outpatient
Physical Therapist - Outpatient Orthopedic & Musculoskeletal Rehabilitation | Elmira, NY Join a premier healthcare organization in the scenic Finger Lakes region as an Outpatient Physical Thera…
Bartender
$10.35 per hour - $10.35 per hour plus tips. Our Winning Family Starts With You! Check out these great benefits! ~ Flexible schedules to help you balance other life commitments (school, ch…
Line Cook
Position Title: Line Cook Pay Range : $22.00 to $23.00 We Make Applying Easy! Want to apply to this job via text messaging? Text JOB to 75000 and search requisition ID number 1473213 …
Senior Customer Success Manager
Senior Customer Success Manager About Obligo Obligo supports and builds trust between landlords and renters by developing financial technology to support the lifecycle of the landlord-tenant …
Mechatronics & Robotics Technician
Job Description: Mechatronics & Robotics Tech  Job Responsibilities: Assist in the design and development of mechatronic systems and robotic applications. Troubleshoot and maintain exist…
Therapy Staffing Coordinator - Bilingual Spanish
Our Ideal SchedulingCoordinator- Bilingual Spanish: Can you communicate well with people in person, by email, or on the phone easily? Do you have a competitive spirit? Are you detail-oriented and enjo…
Survey Party Chief
Survey Party Chief US-NY-Mineola Job ID: 2025-3211 Type: Regular Full-Time # of Openings: 1 Category: GIS/Surveyor The LiRo Group Overview We currently have a need for a …