Data Engineer Clips/ML Data

Medal
New York, NY

The Role

At Medal, we’re redefining how people capture and share gameplay experiences. Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights. We're looking for a seasoned Data Engineer to take full ownership of our Clips/ML data infrastructure, building the next generation of scalable, real-time pipelines that power everything from user-facing discovery to machine learning research. You'll lead the architecture, operations, and performance of data systems that sit at the heart of our product, influencing everything from content indexing to model training.

If you're passionate about building petabyte-scale video pipelines, love working on low-latency systems, and are excited to help define the future of real-time gaming insights, we want to hear from you.

You Will

  • Architect and operate petabyte-scale ingestion pipelines that ingest ~50 k hours of gameplay video every day

  • Design automated QA guard-rails (schema validation, anomaly detection, deduplication)

  • Build high-performance ETL and feature-extraction jobs to process and index hundreds of millions of clips into columnar/video-native formats

  • Own the end-to-end data ingestion stack (desktop & mobile recorders, upload services, CDN)

  • Establish real-time monitoring, lineage, and “five-nines” SLAs, driving continuous improvement across storage, compute, and network layers

  • Partner with research and product to curate high-signal data slices, data-health metrics, and accelerate model experimentation

  • Champion security, privacy, and governance : implement robust RBAC, audit trails, and compliant retention policies for sensitive gameplay footage and user inputs

  • Mentor and uplevel engineers (including internal Medal platform talent), fostering a culture of craftsmanship, documentation, and ruthless focus on data excellence

You Need

  • 5+ years of experience in data engineering, backend systems , or related roles. Experience with video data or ML infrastructur e is a plus.

  • Deep knowledge of ETL/ELT pipelines , distributed systems , and streaming data architectures (e.g., Kafka, Spark, Flink, etc.)

  • Strong proficiency with Python, Scala, Go , or similar languages used in data-intensive environments

  • Experience with cloud infrastructure (e.g., AWS, GCP) and modern data stack tools (e.g., dbt, Airflow, Parquet, Arrow)

  • Track record of designing systems with extreme scale and performance requirements

  • Deep understanding of data QA methodologies , anomaly detection, and automated testing in production systems

  • Passion for mentorship and team development ; able to upskill engineers and advocate for engineering excellence

  • A bias toward ownership, urgency , and a desire to build systems that just work , even at scale

Why Join Us

  • Work on cutting-edge tech and help shape the future of gaming

  • Passionate team that values ownership and innovation

  • Competitive salary, equity options, comprehensive health insurance, 401k

#LI-DH1

Posted 2025-08-24

Recommended Jobs

Senior Software Engineer

Carry
New York, NY

About Carry: At Carry, we help clients build wealth through smart tax optimization. We started with the Solo 401k for self-employed business owners, and are rapidly adding new products and services …

View Details
Posted 2025-08-20

Food Service

Staffworks CNY
Cooperstown, NY

Job Description Job Description Staffworks is recruiting for a Food Service Worker in Cooperstown, NY. 1st Shift: 6:00 a.m.- 3:00 p.m. Pay rate $15/hr 2nd Shift: 11:00 a.m. - 7:00 p.m. Pay ra…

View Details
Posted 2025-07-28

VIP Assistant

Celine
New York, NY

CELINE is seeking a VIP Assistant in New York to support the VIP Team in managing daily responsibilities and strategies. This role involves assisting with VIP dressing opportunities, managing daily re…

View Details
Posted 2025-09-04

Desktop Support Analyst (Hedge Fund)

Oakridge Staffing
New York, NY

Top global alternative asset firm is looking to hire a desktop support person into their Infrastructure team. Responsibilities: ~Provide primary end-user support by responding to and addressing all …

View Details
Posted 2025-08-06

Client Service Supervisor - Rotterdam

Pioneer Bank, National Association
Schenectady, NY

Job Description Job Description TITLE: Client Service Supervisor LOCATION: Rotterdam REPORTS TO: Branch Manager CLASSIFICATION: Full Time, Non Exempt PAY GRADE: NE 30 ($20.00 - $30.1…

View Details
Posted 2025-07-28

Hospital | PT

Farmingdale, NY

Locum Tenens Physical Therapist – Home Health Travel Job in Farmingdale, NY (Long Island) Advance your career as a Locum Tenens Physical Therapist (PT) in Home Health, serving Farmingdale, NY and t…

View Details
Posted 2025-08-29

Behavior Consultant /Full Time - Nassau County

Family of Kidz
Garden City, NY

Job Description Job Description Behavior Consultant Family of Kidz is hiring and has immediate openings! If you are looking to create your own schedule and have a passion for helping kids,…

View Details
Posted 2025-07-29

Program Manager, Middle School Career Exploration

ExpandED Schools
New York, NY

ExpandED is dedicated to ensuring that all young people have access to enriching learning opportunities that affirm their identities, teach them valuable skills, and spark new possibilities. Through p…

View Details
Posted 2025-08-06

Groundsperson - Litchfield Asphalt Plant 1

Clayville, NY

Subsidiary: BARRETT     Barrett Paving Materials Inc . is a leader in heavy civil construction, specializing in aggregate production, asphalt plants, paving services, and road constructio…

View Details
Posted 2025-09-02

Middle School Special Education Teacher (25-26)

Explore Schools
Brooklyn, NY

Middle School Special Education Teacher, Brooklyn, New York In-Person Work Required This is an exempt position and is not eligible for overtime. WHO WE ARE  Explore Schools is a network…

View Details
Posted 2025-08-07