Data Engineer Lead

OverviewWe are authentic, professional providers of fun, focused on building a Great Place To Work For All by staying true to our mission: "Life's a Party, We're Makin' It Fun!" and "So Much Fun It's Scary!"At Spencer's and Spirit Halloween, we do the right thing always-integrity, fairness, respect, and transparency are our foundation. You will find our culture to be inclusive, passionate, resilient, and one that values differences and embraces all.One Team / One GoalWe are leaders and owners of our business success. Whether it's developing new and exclusive costumes, quality testing products, or implementing technology solutions, our teams understand the value of working collaboratively to embrace change through innovation, curiosity, and thoughtfulness.We offer a comprehensive benefits package that includes:Flexible work environmentCareer advancementCompetitive base salaryBonus opportunityVacation, Personal, Sick and Holiday payMedical, Dental, Vision, Disability, Life and AD&D insurance401k with a company match30% merchandise discountResponsibilitiesThe Data Engineer Lead will play a pivotal role in identifying and prioritizing data and transformation requirements to bolster strategies and operational deliverables. Your responsibilities include gathering, documenting, and promoting data engineering best practices, designing and managing algorithms and pipelines in collaboration with diverse teams, and conducting optimizations and root cause analysis for continuous improvement. As a key partner to business and IT stakeholders, you will address data-related technical issues and support BI and data teams' operational requirements.Work in collaboration with the business community in identifying and prioritizing their data and transformation requirements to support their strategies and operational deliverablesGather, document, promote, enforce, and maintain relevant data engineering best practicesDesign, deliver and manage the algorithms and pipelines for acquiring the information and addressing the business need - in collaboration with the architects, the business intelligence team and the data governance teamPerform optimizations and root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvementsPartner with business and IT stakeholders to assist with data-related technical issues and support BI and data teams' operational requirementsWork with data and analytics experts to strive for greater functionality, traceability and cross-functional cohesion in our data systemsAssist the development and architecture teams on data quality and various POC initiativesExperience contributing to the architecture and design utilizing Databricks for ML/AI systems and tools

Strong sense of software design and usability using LLM & RAG

QualificationsGraduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field, with a strong advantage if certified in Databricks Data EngineeringAt least eight years of working experience/knowledge in designing, building, and optimizing data pipelines, and data setsAt least three years of experience working in Azure and Databricks technologyWorking SQL knowledge and experience with relational databases, query authoring (SQL)Working knowledge performing root cause analysis on internal and external data processing related issuesUnderstanding processes supporting data transformation, data structures, metadata, dependency, and workload managementKnowledge with big data tools: Hadoop, Spark, etc. Knowledge of relational SQL and NoSQL databasesKnowledge of object-oriented/object function scripting languages: Python, Java, etc.

#J-18808-Ljbffr