Data Engineer Clips/ML Data

Medal
New York, NY

The Role

At Medal, we’re redefining how people capture and share gameplay experiences. Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights. We're looking for a seasoned Data Engineer to take full ownership of our Clips/ML data infrastructure, building the next generation of scalable, real-time pipelines that power everything from user-facing discovery to machine learning research. You'll lead the architecture, operations, and performance of data systems that sit at the heart of our product, influencing everything from content indexing to model training.

If you're passionate about building petabyte-scale video pipelines, love working on low-latency systems, and are excited to help define the future of real-time gaming insights, we want to hear from you.

You Will

  • Architect and operate petabyte-scale ingestion pipelines that ingest ~50 k hours of gameplay video every day

  • Design automated QA guard-rails (schema validation, anomaly detection, deduplication)

  • Build high-performance ETL and feature-extraction jobs to process and index hundreds of millions of clips into columnar/video-native formats

  • Own the end-to-end data ingestion stack (desktop & mobile recorders, upload services, CDN)

  • Establish real-time monitoring, lineage, and “five-nines” SLAs, driving continuous improvement across storage, compute, and network layers

  • Partner with research and product to curate high-signal data slices, data-health metrics, and accelerate model experimentation

  • Champion security, privacy, and governance : implement robust RBAC, audit trails, and compliant retention policies for sensitive gameplay footage and user inputs

  • Mentor and uplevel engineers (including internal Medal platform talent), fostering a culture of craftsmanship, documentation, and ruthless focus on data excellence

You Need

  • 5+ years of experience in data engineering, backend systems , or related roles. Experience with video data or ML infrastructur e is a plus.

  • Deep knowledge of ETL/ELT pipelines , distributed systems , and streaming data architectures (e.g., Kafka, Spark, Flink, etc.)

  • Strong proficiency with Python, Scala, Go , or similar languages used in data-intensive environments

  • Experience with cloud infrastructure (e.g., AWS, GCP) and modern data stack tools (e.g., dbt, Airflow, Parquet, Arrow)

  • Track record of designing systems with extreme scale and performance requirements

  • Deep understanding of data QA methodologies , anomaly detection, and automated testing in production systems

  • Passion for mentorship and team development ; able to upskill engineers and advocate for engineering excellence

  • A bias toward ownership, urgency , and a desire to build systems that just work , even at scale

Why Join Us

  • Work on cutting-edge tech and help shape the future of gaming

  • Passionate team that values ownership and innovation

  • Competitive salary, equity options, comprehensive health insurance, 401k

#LI-DH1

Posted 2025-09-15

Recommended Jobs

Budget Analyst

Cooper Hewitt
New York, NY

The Budget Analyst reports to the Director of Finance and provides administrative and technical support in the areas budget formulation, execution, contracting and procurement. SUMMARY OF DUTIES: • …

View Details
Posted 2025-08-06

Sales Support Associate

Foresters Financial
Westbury, NY

Description What we need: This role supports the Registered Financial Services Sales Representative’s business with day-to-day administrative assistance while enhancing the service experience of…

View Details
Posted 2025-08-06

Director of Business Development

New York, NY

Opportunity to join a highly-ranked global law firm Lead a team of skilled BD professionals across multiple offices in US About Our Client This role is with a well-established and highly ran…

View Details
Posted 2025-09-08

Clinician Home Based Crisis Intervention

Astor Services
Kingston, NY

Job Description Job Description Description: We have openings in Westchester, Putnam, Columbia, Greene and Dutchess Counties! Accelerate your professional and personal growth as a valued mem…

View Details
Posted 2025-07-28

Labor and Employment Associate

Traub Lieberman Straus & Shrewsberry LLP
Hawthorne, NY

Job Description Job Description Traub Lieberman is a nationally recognized law firm with over 90 attorneys across six offices. With a strong foundation in various service areas and a focus on str…

View Details
Posted 2025-07-30

Millworker-Fabricator

Eventscape Inc.
New York, NY

Job Description Job Description Eventscape has an exciting opportunity for an experienced  Carpenter (Custom Millwork Fabricator)to join our woodshop. The ideal candidate will be an elite craftsp…

View Details
Posted 2025-07-30

Administrative Assistant

New York Life Insurance Co
New York, NY

Location Designation: Hybrid - 4 days per week    Our New York Life culture has laid the foundation for over 180 years of commitment to our employees, agents, policy owners, and the communities wh…

View Details
Posted 2025-07-29

Senior Software Engineer

Better
New York, NY

Better is reimagining home finance and making it faster, cheaper, and easier for everyone to become a homeowner. We leverage creative technology and innovation to make the home buying journey more ap…

View Details
Posted 2025-09-14

Jr. IT Project Engineer

Atlas Technica
New York, NY

Position Name: Junior Project Engineer Reports to: Project Engineer Team Lead Location/Type: New York, New York/Hybrid Status: Exempt Atlas Technica's mission is to shoulder IT management, u…

View Details
Posted 2025-09-01