Sr Lead Big Data Developer

Sr Lead Big Data Developer at Lumen in Boise, Idaho, United States Job Description About Lumen Lumen connects the world. We are igniting business growth by connecting people, data and applications - quickly, securely, and effortlessly. Together, we are building a culture and company from the people up - committed to teamwork, trust and transparency. People power progress. We're invested in providing the flexibility you need to thrive and deliver lasting impact. Apply now to continue digitally connecting the world and shaping the future. The Role We are looking for a Senior Lead Big Data Developer who is passionate about working with large scale systems using cutting-edge technologies and tools to help identify and disrupt malicious threats on the Internet. You will be part of a dynamic and collaborative team with an opportunity to lead the team that develops software to help identify and find threats within network like datasets. The Main Responsibilities Provide technical direction in the creation, implementation, and integration of complex big data solutions Collaborate and translate business requirements into implementation design and participate in the design, evaluation, and selection of best software solutions to achieve business objectives Design, develop, test, and deploy scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc. Perform data quality checks and validations, and handle data anomalies and issues Collaborate with other developers, data engineers, data analysts, and business stakeholders to understand data requirements and deliver data solutions Develop scalable systems that enable real-time validation of identified resources Mentor junior developers and engineers on the team and champion industry best practices Explore, evaluate and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current processes What We Look For in a Candidate Master's or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience Can demonstrate past experience in developing and working with big data technologies, such as Spark, Kafka, Hadoop, Hive, etc. Proficient in programming languages, such as Python, Java, Scala, or SQL Strong analytical and problem-solving skills, and attenti To view full details and how to apply, please login or create a Job Seeker account