Lead data engineer python
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You’ll Do:- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
- Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
- Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
- Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
- Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
- Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
- Bachelor’s Degree
- At least 4 years of experience in application development (Internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
- 7+ years of experience in application development including Python, SQL, Scala, or Java
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
- 4+ year experience working on real-time data and streaming applications
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 4+ years of data warehousing experience (Redshift or Snowflake)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- 2+ years of experience with Agile engineering practices
Recommended Jobs
CATERING ATTENDANT (FULL TIME)
We are hiring immediately for a full time CATERING ATTENDANT position. Location : Willkie Catering - 787 7th Avenue, New York, NY 10019 Note: online applications accepted only . Schedu…
Spanish Pre-K Teacher - Education Masters + Citizenship Required
Reade Street Prep PRE-K HEAD SPANISH TEACHER Who We Are: Reade Street Prep is a contemporary preschool in Tribeca dedicated to providing students with the opportunity to develop a love of lear…
AI Engineer (Curator)
About the role Hex is an AI-powered platform for modern Data Science and Data Analytics workflows. AI Engineers at Hex partner with product teams to build industry-leading AI experiences such as t…
Senior Software Engineer - City Environmental Quality Review
Job Description THIS POSITION IS TEMPORARILY FUNDED THROUGH DECEMBER 2027 WITH THE POSSIBILITY OF FURTHER EXTENSION. THE AGENCY The Department of City Planning (DCP) plans for the strategi…
Procurement Project Manager
Req ID:484567 At Alstom, we understand transport networks and what moves people. From high-speed trains, metros, monorails, and trams, to turnkey systems, services, infrastructure, signalling a…
Bilingual Early Intervention Service Coordinator
Thrive By 5 is currently hiring Bilingual Service Coordinators for the Early Intervention Program throughout New York City (Brooklyn, Queens, Bronx, and Manhattan). This position involves providing c…
Line Cook
Chef Daniel Boulud is seeking an enthusiastic and capable individual who is passionate about hospitality to join our Banquet Team at Summit Events . We are seeking a skilled and dependable Li…
Data Scientist
True Environmental and its partner firms, have united their strengths to establish the nation's premier environmental and engineering services consulting firm. This powerhouse organization offers an …
Android Developer
Job Overview We are looking for an experienced and skilled Android Developer to join our Development team. As an Android Developer, you will be responsible for developing mobile applications fo…
Temporary Recruiter
TEMPORARY RECRUITER Supporting Richemont Functions or Maisons 6 month temporary assignment Role Overview As a crucial member of the talent team, you will play an essential role in execut…