Senior Lead Data Engineer (Python/Scala, Spark, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.The Senior Lead Data Engineer sits within the Card Data Organization & the Data Foundations group, our team works on the foundational capabilities of how data should be produced and consumed. These foundational capabilities include a variety of initiatives as well as AI Assist Tools to enable us to speed the production & consumption of data. The teams are involved in migrating our Batch workloads to the new publishing platform for improved governance and observability. Our environment involves Batch Pipelines involving core technologies such as Scala, Python, Spark, EMR, Glue, Airflow, Step Functions, Delta, Uniform Catalog, Iceberg, DynamoDB amongst many others. On a day to day basis this team tackles problems of massive scale, critical data footprint that has bottom line business impact, resiliency & availability requiring the best techniques within Big Data Analytics and Machine Learning all while providing a superior analyst experience on our tool.

Want more jobs like this?Getjobsdelivered to your inbox every week.

Want more jobs like this?

Getjobsdelivered to your inbox every week.

Select a locationGet Jobs

Select a location