Capital One
Lead Data Engineer - Spark, Scala, SQL
Capital One, Charlottesville, Virginia, United States, 22904
Are you passionate about using data to drive innovative solutions? Join our team as a Lead Data Engineer and collaborate with experienced professionals to develop and implement cutting-edge strategies using the latest technologies. As part of our agile team, you'll have the opportunity to design, build, and own services leveraging a wide range of technologies, including Spark, Scala, and Python, and work on the AWS infrastructure. Your role will involve collaborating with digital product managers to deliver cloud-based solutions, while staying updated on tech trends and mentoring other members of the engineering community.Collaborate with Agile teams to design, develop, and support technical solutions in full-stack development tools and technologiesUtilize programming languages like Scala and Open Source RDBMS and NoSQL databases, as well as Cloud based data warehousing servicesShare your passion for staying on top of tech trends, experimenting with and learning new technologies, and mentoring other members of the engineering communityPerform unit tests and conduct reviews to ensure rigorous code design and optimal performanceBasic Qualifications:Bachelor's DegreeAt least 4 years of experience in application developmentAt least 2 years of experience in big data technologiesAt least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)Preferred Qualifications:7+ years of experience in application development including SQL or Scala4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)4+ years experience with Distributed data/computing tools (Kafka or Spark)4+ years experience working on Real Time data and streaming applications4+ years of experience with NoSQL implementation (Mongo or Cassandra)4+ years of data warehousing experience (Redshift or Snowflake)4+ years of experience with UNIX/Linux including basic commands and Shell Scripting2+ years of experience with Agile engineering practices