Data Engineer Clips/ML Data

Medal
New York, NY

The Role

At Medal, we’re redefining how people capture and share gameplay experiences. Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights. We're looking for a seasoned Data Engineer to take full ownership of our Clips/ML data infrastructure, building the next generation of scalable, real-time pipelines that power everything from user-facing discovery to machine learning research. You'll lead the architecture, operations, and performance of data systems that sit at the heart of our product, influencing everything from content indexing to model training.

If you're passionate about building petabyte-scale video pipelines, love working on low-latency systems, and are excited to help define the future of real-time gaming insights, we want to hear from you.

You Will

  • Architect and operate petabyte-scale ingestion pipelines that ingest ~50 k hours of gameplay video every day

  • Design automated QA guard-rails (schema validation, anomaly detection, deduplication)

  • Build high-performance ETL and feature-extraction jobs to process and index hundreds of millions of clips into columnar/video-native formats

  • Own the end-to-end data ingestion stack (desktop & mobile recorders, upload services, CDN)

  • Establish real-time monitoring, lineage, and “five-nines” SLAs, driving continuous improvement across storage, compute, and network layers

  • Partner with research and product to curate high-signal data slices, data-health metrics, and accelerate model experimentation

  • Champion security, privacy, and governance : implement robust RBAC, audit trails, and compliant retention policies for sensitive gameplay footage and user inputs

  • Mentor and uplevel engineers (including internal Medal platform talent), fostering a culture of craftsmanship, documentation, and ruthless focus on data excellence

You Need

  • 5+ years of experience in data engineering, backend systems , or related roles. Experience with video data or ML infrastructur e is a plus.

  • Deep knowledge of ETL/ELT pipelines , distributed systems , and streaming data architectures (e.g., Kafka, Spark, Flink, etc.)

  • Strong proficiency with Python, Scala, Go , or similar languages used in data-intensive environments

  • Experience with cloud infrastructure (e.g., AWS, GCP) and modern data stack tools (e.g., dbt, Airflow, Parquet, Arrow)

  • Track record of designing systems with extreme scale and performance requirements

  • Deep understanding of data QA methodologies , anomaly detection, and automated testing in production systems

  • Passion for mentorship and team development ; able to upskill engineers and advocate for engineering excellence

  • A bias toward ownership, urgency , and a desire to build systems that just work , even at scale

Why Join Us

  • Work on cutting-edge tech and help shape the future of gaming

  • Passionate team that values ownership and innovation

  • Competitive salary, equity options, comprehensive health insurance, 401k

#LI-DH1

Posted 2025-11-25

Recommended Jobs

SLP- Pediatric Speech Therapist

Yeled v'Yalda
Brooklyn, NY

Yeled v'Yalda is seeking Speech Therapists in Brooklyn, NY, for full time and part time positions.  New graduates welcome!   Locations available:Brooklyn: Boro Park, Williamsburg, and Crown Heights…

View Details
Posted 2025-11-27

.NET Developer, Bureau of IT Application and Platform Engineering

DEPT OF HEALTHMENTAL HYGIENE
New York, NY

Job Description OPEN TO PERMANENT CYBER SECURITY. The Bureau of Application Development & Database Administration is committed to providing high quality, customized software business solut…

View Details
Posted 2025-11-20

Regional Office Assistant Greater NYC Region

Young Life
New York, NY

If you are currently on Young Life staff pleasedo not apply through this external jobs apply for internal job opportunities log in to Workday and use the Jobs Hub. Applying externally may delay your…

View Details
Posted 2025-11-27

Business Application Owner

TD Bank
New York, NY

Work Location : New York, New York, United States of America Hours 40 Line Of Business TD Securities Pay Detail $110,000 - $130,000 USD TD is committed to providing fair and equ…

View Details
Posted 2025-11-27

Specialist, Global Procurement - FC&L

Regeneron
Tarrytown, NY

The Specialist, Global Procurement – Facilities, Capital & Logistics (FC&L) will support the Capital Lab Equipment and Services business. This role is accountable for supporting the category strategy…

View Details
Posted 2025-11-07

[Spring 2026] Curatorial - Time-Based Media Internship

Whitney Museum of American Art
New York, NY

The Whitney’s Academic Year Internship program offers a semester-long paid internship for undergraduate and graduate students currently enrolled in an accredited academic program. The internship is h…

View Details
Posted 2025-09-10

Environmental Services Worker I

Roswell Park Cancer Institute
Buffalo, NY

Title: Environmental Services Worker I Job Type: Regular Company: Roswell Park Comprehensive Cancer Center Department: Environmental Services Time Type: Part time Weekly Hours: …

View Details
Posted 2025-11-15

Supervisor

Starbucks
New York, NY

Crafting the world's finest coffee, one meaningful moment at a time We believe in creating a warm and welcoming space where every cup of coffee sparks connection. Every shift is a chance to bri…

View Details
Posted 2025-11-26

Onboard Stitcher

RWS Global
New York, NY

About RWS Global   RWS Global is the world leader in groundbreaking live moments across entertainment and sports,   creating customized guest experiences spanning theatrical productions, live eve…

View Details
Posted 2025-10-27

Dental Network Service Representative

Highmark Health
Albany, NY

**Company :** United Concordia Dental **Job Description :** JOB SUMMARY ****** MUST BE A US CITIZEN ****** Looking for someone with Dental Provider Relations to service United Concordia Dental's (UCD'…

View Details
Posted 2025-11-14