Software Engineer, Data Platform

Hiring for multiple roles.

Traditional forecasting breaks under petabytes of features, megabytes of labels, and time-varying noise. Our breakthrough research is foundational in the field: generating industry-beating results ( MIT News ). Our predictive engines combine a wide variety of data through rigorous scientific process. We leverage alternative datasets (consumer transactions, geolocation, etc) along with private, public, external, and internal data.

The Data Platform is a critical component in our scientific approach to forecasting. The role will require everything from high-level architecture design to performant implementation.

Responsibilities include:

• Build distributed systems supporting complex transformations over petabyte-scale data


• Design, implement, and maintain production cloud data pipelines for complex, disparate datasets


• Work closely with our Quants and Applied Scientists to support rigorous scientific process, rapid experimentation, and new product initiatives

Required qualifications:

• Bachelor’s or advanced degree in Computer Science, math or equivalent


• 3+ years of experience in data engineering or related fields with a track record of building (coding) and scaling a data platform


• 2+ years of industry experience building ETL pipelines in a major cloud provider


• Highly proficient in python and SQL


• Advanced knowledge of databases, design patterns, OOP, and concurrency


• Knowledge of data management fundamentals and data storage principles


• Passion for intuitive data models


• Experience communicating with senior management as well as colleagues from engineering, analytics, and business backgrounds


• Experience with AWS, orchestration platforms, and modern tech stacks


• Strong software engineering fundamentals: system design, algorithms, data structures

Nice-to-haves:

• Experience building systems that integrate LLMs with large-scale data processing


• Working understanding of basic probability and statistics


• Experience implementing ML models


• Experience with DBT


• MS or PhD in STEM field

In-person at our NYC office strongly preferred. Remote candidates who can spend some time in-office (e.g., monthly) will also be considered.

Benefits:

• The salary range for this position is $145,000-$220,000


• Free health, vision, dental insurance


• 401k with match


• Unlimited PTO + 13 company holidays


• Daily Grubhub lunch stipend


• Pre-tax commuter benefits