Logo
1872 Consulting

Remote Data Engineer

1872 Consulting, Oak Brook, Illinois, United States, 60523


Sr. Data EngineerRemote - Onsite 3 days per month in Greater Chicago

Position Summary:This role is responsible for providing technical expertise and leadership to design and deliver end-to-end data engineering solutions to support advanced analytics capabilities and drive innovation and decision-making across our enterprise.

Responsibilities:

Build and maintain real-time and batch data pipelines across the advanced analytics platform.Design, develop and orchestrate highly robust and scalable ETL pipelines.Design and implement Dimensional and NoSQL data modeling as per the business requirements.Develop highly optimal codebase and perform Spark optimizations for Big Data use cases.Design, develop and deploy optimal monitoring and testing strategy for the data products.Collaborate with stakeholders and advanced analytics business partners to understand business needs and translate requirements into scalable data engineering solutions.Collaborate with data scientists to prepare data for model development and production.Collaborate with data visualization and reporting application developers to ensure the sustainability of production applications and reports.Collaborate with data architects on the enhancement of our enterprise data architecture and platforms.Provide leadership to third-party contractors.Comply with health and safety guidelines and rules.Maintain professional and technical knowledge by attending educational workshops, professional publications, establishing personal networks, and participating in professional societies.

Requirements:

4+ years of experience in Data Engineering2+ years of experience with Advanced Analytics or Data ScienceProficient in SparkExperience with Azure

Nice to have:

Experience with IoT Data Architecture.Machine Learning Operationalization (MLOps) proficiency.Proficiency with streaming design patterns

#J-18808-Ljbffr