Data Engineer Clips/ML Data
The Role
At Medal, we’re redefining how people capture and share gameplay experiences. Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights. We're looking for a seasoned Data Engineer to take full ownership of our Clips/ML data infrastructure, building the next generation of scalable, real-time pipelines that power everything from user-facing discovery to machine learning research. You'll lead the architecture, operations, and performance of data systems that sit at the heart of our product, influencing everything from content indexing to model training.
If you're passionate about building petabyte-scale video pipelines, love working on low-latency systems, and are excited to help define the future of real-time gaming insights, we want to hear from you.
You Will
Architect and operate petabyte-scale ingestion pipelines that ingest ~50 k hours of gameplay video every day
Design automated QA guard-rails (schema validation, anomaly detection, deduplication)
Build high-performance ETL and feature-extraction jobs to process and index hundreds of millions of clips into columnar/video-native formats
Own the end-to-end data ingestion stack (desktop & mobile recorders, upload services, CDN)
Establish real-time monitoring, lineage, and “five-nines” SLAs, driving continuous improvement across storage, compute, and network layers
Partner with research and product to curate high-signal data slices, data-health metrics, and accelerate model experimentation
Champion security, privacy, and governance : implement robust RBAC, audit trails, and compliant retention policies for sensitive gameplay footage and user inputs
Mentor and uplevel engineers (including internal Medal platform talent), fostering a culture of craftsmanship, documentation, and ruthless focus on data excellence
You Need
5+ years of experience in data engineering, backend systems , or related roles. Experience with video data or ML infrastructur e is a plus.
Deep knowledge of ETL/ELT pipelines , distributed systems , and streaming data architectures (e.g., Kafka, Spark, Flink, etc.)
Strong proficiency with Python, Scala, Go , or similar languages used in data-intensive environments
Experience with cloud infrastructure (e.g., AWS, GCP) and modern data stack tools (e.g., dbt, Airflow, Parquet, Arrow)
Track record of designing systems with extreme scale and performance requirements
Deep understanding of data QA methodologies , anomaly detection, and automated testing in production systems
Passion for mentorship and team development ; able to upskill engineers and advocate for engineering excellence
A bias toward ownership, urgency , and a desire to build systems that just work , even at scale
Why Join Us
Work on cutting-edge tech and help shape the future of gaming
Passionate team that values ownership and innovation
Competitive salary, equity options, comprehensive health insurance, 401k
#LI-DH1
Recommended Jobs
Senior Software Engineer
About Carry: At Carry, we help clients build wealth through smart tax optimization. We started with the Solo 401k for self-employed business owners, and are rapidly adding new products and services …
Food Service
Job Description Job Description Staffworks is recruiting for a Food Service Worker in Cooperstown, NY. 1st Shift: 6:00 a.m.- 3:00 p.m. Pay rate $15/hr 2nd Shift: 11:00 a.m. - 7:00 p.m. Pay ra…
VIP Assistant
CELINE is seeking a VIP Assistant in New York to support the VIP Team in managing daily responsibilities and strategies. This role involves assisting with VIP dressing opportunities, managing daily re…
Desktop Support Analyst (Hedge Fund)
Top global alternative asset firm is looking to hire a desktop support person into their Infrastructure team. Responsibilities: ~Provide primary end-user support by responding to and addressing all …
Client Service Supervisor - Rotterdam
Job Description Job Description TITLE: Client Service Supervisor LOCATION: Rotterdam REPORTS TO: Branch Manager CLASSIFICATION: Full Time, Non Exempt PAY GRADE: NE 30 ($20.00 - $30.1…
Hospital | PT
Locum Tenens Physical Therapist – Home Health Travel Job in Farmingdale, NY (Long Island) Advance your career as a Locum Tenens Physical Therapist (PT) in Home Health, serving Farmingdale, NY and t…
Behavior Consultant /Full Time - Nassau County
Job Description Job Description Behavior Consultant Family of Kidz is hiring and has immediate openings! If you are looking to create your own schedule and have a passion for helping kids,…
Program Manager, Middle School Career Exploration
ExpandED is dedicated to ensuring that all young people have access to enriching learning opportunities that affirm their identities, teach them valuable skills, and spark new possibilities. Through p…
Groundsperson - Litchfield Asphalt Plant 1
Subsidiary: BARRETT Barrett Paving Materials Inc . is a leader in heavy civil construction, specializing in aggregate production, asphalt plants, paving services, and road constructio…
Middle School Special Education Teacher (25-26)
Middle School Special Education Teacher, Brooklyn, New York In-Person Work Required This is an exempt position and is not eligible for overtime. WHO WE ARE Explore Schools is a network…