1872 Consulting
Lead Data Engineer
1872 Consulting, Oak Brook, Illinois, United States, 60523
Lead Data EngineerGreater Chicago area - Onsite 3 days per week
Position Summary:This role is responsible for providing technical leadership and execution expertise to design and deliver end-to-end data engineering solutions to support new product development and advanced analytics capabilities and drive innovation and decision-making across our company.
Responsibilities:Collaborate with stakeholders, including product owners and developers, as well as advanced analytics colleagues, including data scientists and data visualization developers, to understand product and business requirements and translate into scalable data engineering solutions.Build and maintain real-time and batch data pipelines across the advanced analytics platform, including design of data flows, procedures, and schedules for internally and externally sourced data.Collaborate with data scientists to prepare data for model development and production.Collaborate with data visualization and reporting application developers to ensure the sustainability of production applications and reports.Partner with the Lead Architect in data architecture and solution design.Perform design, code, and test plan reviews in support of maintaining data engineering standards.Comply with health and safety guidelines and rules.Contribute to the team effort by accomplishing related results and participating on projects as needed.
Requirements:7+ years of experience in Data Engineering.Experience delivering engineering for Client/AI solutions.Proficient in Spark.Experience with Azure.
Nice to have:Experience with Databricks, Azure Data Factory, Event Hubs and/or Azure Devops.Experience working in transportation, logistics, or network optimization.Experience with IoT Data Architecture.Leadership experience.
#J-18808-Ljbffr
Position Summary:This role is responsible for providing technical leadership and execution expertise to design and deliver end-to-end data engineering solutions to support new product development and advanced analytics capabilities and drive innovation and decision-making across our company.
Responsibilities:Collaborate with stakeholders, including product owners and developers, as well as advanced analytics colleagues, including data scientists and data visualization developers, to understand product and business requirements and translate into scalable data engineering solutions.Build and maintain real-time and batch data pipelines across the advanced analytics platform, including design of data flows, procedures, and schedules for internally and externally sourced data.Collaborate with data scientists to prepare data for model development and production.Collaborate with data visualization and reporting application developers to ensure the sustainability of production applications and reports.Partner with the Lead Architect in data architecture and solution design.Perform design, code, and test plan reviews in support of maintaining data engineering standards.Comply with health and safety guidelines and rules.Contribute to the team effort by accomplishing related results and participating on projects as needed.
Requirements:7+ years of experience in Data Engineering.Experience delivering engineering for Client/AI solutions.Proficient in Spark.Experience with Azure.
Nice to have:Experience with Databricks, Azure Data Factory, Event Hubs and/or Azure Devops.Experience working in transportation, logistics, or network optimization.Experience with IoT Data Architecture.Leadership experience.
#J-18808-Ljbffr