Senior data engineer - data
Thank you for considering Progyny!
Data is the lifeblood of healthcare, and Progyny as a company depends on the accurate, timely, and secure management of data to achieve our company mission at the highest level. This role will directly support all Machine Learning and AI based solutions at Progyny. This role will be directly responsible for supporting Progyny’s efforts to provide an enhanced member experience and better insights to our team leveraging best in class components for core data persistence, streaming, transformation, and integrated analytics leveraging machine learning. As data systems are constantly evolving, this role will also be expected to help challenge and mature the existing patterns, practices and tool chains for the Data engineering discipline at Progyny; as such, a successful candidates should be motivated by a desire to help optimize and shape their environment, not simply follow the established status quo. Success in this role is measured by the following:- Development of data pipelines that meet or exceed our quality goals
- Ability to leverage your knowledge of various data patterns/frameworks/tools to help guide implementation to best possible solutions
- Staying curious and ensuring currency in a fast-evolving technology discipline while also supporting growth/maturity of your peers & stakeholders
- Working “without a net”: navigating past ambiguity through the application of your judgment and experience
- Ability to find pragmatic options to tactical vs. strategic implementation dilemmas
- Working with machine learning and AI stakeholders to design and implement numerous data transformation pipelines, with a focus on all functional/non-functional quality goals
- Design and implementation of test, monitoring, and observability strategies for data systems and processes
- Support for outage incident response and return-to-service activities for data systems in your purview
- Supporting evaluation of related tools, frameworks and dev/test/deploy patterns as needed to evolve the platform capabilities for data support
- Strong communication skills
- Experience with well-known data pipeline/transform tools / platforms (DAG-based options like Airflow, Dagster, Prefect, etc.)
- 7+ years of consistent, professional SQL development experience
- 5+ years of Python development experience
- Experience with data access patterns (caching, partitioning, sharding)
- Familiarity with data modeling best practices / data structures/ data warehousing
- Experience with Machine Learning and AI training and inference pipeline development.
- Experience working on streaming/event pipelines using Kafka or similar technology.
- Working experience with the FHIR JSON-based storage models.
- Experience working with graph data models and databases.
- Family friendly benefits: Paid family and parental leave, preconception, fertility and family building benefits (including egg freezing, IVF, and adoption support), family and pet care fund, and Parents’ Employee Affiliation Group
- Menopause and midlife care
- Health, dental, vision and life insurance options for employees and family
- Free in-person, virtual and text-based mental health and wellness support
- Paid time off, including vacation, sick leave, personal days and summer flex time
- Company equity
- Bonus program
- 401(k) plan with company match
- Access to on-demand legal and financial advice
- Learning and development programs to help you grow professionally and a mentorship program
- Company social events to include annual volunteer day and donation matching
- Flex days (3 days a week in the office) and onsite meals and snacks for employees reporting into our NY office
Recommended Jobs
Lead QA Engineer
About Evertune AI: Evertune is building the first AI discovery platform for modern marketers. As large language models (LLMs) become the go-to source for recommendations – we help brands understand …
Maitre D
We are seeking a motivated individual with a minimum of 3 years experience as either a Maitre D' or Restaurant Manager to lead the Chinese Tuxedo host team. Our ideal candidate must have prior experi…
Connected Supply Chain, Planning - Kinaxis, Director Save for Later Remove job
Job Title Connected Supply Chain, Planning - Kinaxis, Director Job Category Operations Consulting Level Director Specialty/Competency Operations Industry/Sector Not Applicable Job Type Reg…
Attorney, Tax
(New York, NY) Represent int’l & dom. banks, inv. funds, publ. & priv. co’s, PE funds in tax matters rel. to debt financings, sec. offerings, eq. derivatives, M&A, securitizations, fin. products, r…
Senior Data Engineer
Company Description Curinos empowers financial institutions to make better, faster and more profitable decisions through industry-leading proprietary data, technologies and insights. With decade…
Receptionist
Job Overview Do you have a pleasant personality and excellent communication skills? If yes, you could be a perfect fit for this role. We are looking for a Receptionist to maintain and manage ou…
Food Runner @ Midtown East | Join the Fiesta
Are you ready to work where every shift feels like a celebration? At Rosa Mexicano , we combine the vibrant spirit of Mexico with an elevated dining experience — and we’re looking for passionate, u…