Capital One
Senior Data Engineer - Python, Spark
Capital One, Mc Lean, Virginia, us, 22107
We are looking for a Senior Data Engineer with expertise in Python and Spark to join our Enterprise Platforms Technology team. We are seeking individuals passionate about utilizing emerging technologies to solve complex business problems in a collaborative and fast-paced environment. As a Senior Data Engineer at Capital One, you will play a key role in driving a major transformation within the company.Responsibilities:Lead Agile teams in designing, developing, and implementing technical solutions using full-stack development tools and technologiesCollaborate with a team of experienced developers in machine learning, microservices, and full stack systemsUtilize programming languages like Java, Scala, Python, and open-source databases, as well as cloud-based data warehousing servicesStay updated on tech trends, experiment with new technologies, and mentor other members of the engineering communityPartner with digital product managers to deliver robust cloud-based solutions that drive powerful customer experiencesConduct unit tests and code reviews to ensure high-quality, performance-optimized codeBasic Qualifications:Bachelor's DegreeMinimum 4 years of application development experienceAt least 2 years of big data technologies experience1 year of cloud computing experience (AWS, Microsoft Azure, Google Cloud)Preferred Qualifications:7+ years of application development experience including Python, SQL, Scala, or Java4+ years of experience with a public cloud platformExperience with distributed data/computing tools, real-time data and streaming applications, NoSQL databases, and data warehousing2+ years of Agile engineering practices