ACI Infotech
Lead Data Engineer
ACI Infotech, Atlanta, Georgia, United States, 30383
Data Engineering Lead (Marketing) Position Description (General role information, job purpose, main objectives of the role)
Location: Atlanta, GA
Duration: FULL TIME / C2H
Mode: Hybrid ( 2 days a Week)
This Data Engineering Lead (Marketing) position is part of Client IT's Marketing Technology team focused on enabling the development and roll-out of world-class modern Marketing Data Engineering capabilities at Client. This role partners with teams responsible for Marketing and Digital Guest Engagement platforms that leverage world-class technology to create personalized, relevant, data-driven experiences. In this role, you will lead teams designing and building Data & BI solutions that capture, explore, transform, and utilize curated data to support Marketing Business Unit's Data-driven transformation journey and decision-making process. In addition to leading the design and implementation of data products, you will also mentor and develop a team of contingent worker data engineers onsite and offshore.
Duties and Responsibilities: (Scope of the role, day to day activities, expected outcomes, highlights any complexities associated with the role)
Thought Leadership (20%) • Provides industry thought leadership to fellow team members across business and technical project dimensions, solving complex business requirements. • Proactively considers the future state of the organization and how technology can support these efforts. • Advocates and define Marketing Data Engineering vision from a strategic perspective, including internal and external platforms, tools, and systems. • Maintains overall MarTech industry Data knowledge on latest trends, technology, etc. • Mentoring (20%) Manage and lead a technical team responsible for data engineering and analysis. • focusing on individual's professional development as well as overall team health and technical proficiency on their assigned project tasks. • Conducts product work reviews with team members. • Serves in the development of team members by actively facilitating new learning opportunities and experiences in the Data Engineering space.
Development (20%) • Design and implement scalable data solutions on Azure platform using Data Factory, Databricks, PySpark, Python and other related services. • Build data pipelines and workflows to ingest, transform, and load data from various sources. • Develop and maintain data models and schemas for efficient data storage and retrieval. • Develop and maintain CI/CD pipelines for automated deployment and testing of data solutions. • Lead development and production deployment of analytic Data and BI products (also potentially pilots and proof of concepts), determining appropriate design strategies and methodologies.
Collaborations (20%) • Collaborate and maintain relationships with cross-functional teams (Cloud Infra, Enterprise Data & IT-SEC) to ensure data solutions meet business requirements. • Continuously evaluate and recommend new data technologies and approaches to improve data solutions. • Develop business partnerships and influence priorities by identifying solutions that are aligned with current business objectives and closely follow industry trends; understanding how to apply them and sharing knowledge with coworkers. • Communicate with partners, describing technology concepts in ways the business can understand, documenting initiatives in a concise and clear manner. • Partner with Enterprise Data management & information security colleagues to ensure the adherence of Data Governance standards for Client. • Data Engineering Lead (Marketing)
Delivery Management (20%) • Find creative solutions to challenging problems involving factors with potentially broad implications; reflecting on solutions, measuring impact, and using that information to ideate and optimize. • Execute data strategies with an understanding of enterprise architecture, consumption patterns, platforms and application infrastructure. • Stay ahead of the impediments to ensure a smooth, on time and in budget, implementation of Data Projects • Collect weekly status updates from Dev teams across multiple Data POD teams and consolidate for leadership project health reporting.
Work Experience/ Education: (Required work experience and education / preferred experience and education that is beneficial to the role. Work experience can include management experience or any functional expertise where proficiency is necessary to be successful in the role) • Bachelor's degree in computer science, Information Technology or a related study, or equivalent experience • 5+ years of hands-on Data Engineering experience with On-Prem and Cloud based Data tools/Platforms, • 3+ years of experience in data engineering with expertise specifically in Azure Data Factory, Databricks, PySpark, Python and related services. • Proven experience in leading and managing technical teams in data engineering and analysis. • Experience in designing and developing data models and schemas. • Strong proficiency in programming languages such as Python. • Experience in developing and maintaining CI/CD pipelines for automated deployment and testing. • Good understanding of cloud computing and its services (e.g., Azure, AWS, GCP). • Excellent problem-solving skills and ability to work in a fast-paced environment. • Experience with the some of the following concepts: Real-time & Batch Data Processing, Workload Orchestration, Cloud, Data lakes, Data Security, Networking, Serverless, Testing / Test Automation (Unit, Integration, Performance, etc.), WebServices, DevOps, Logging, Monitoring, and Alerting, Containerization, Encryption / Decryption, Data Masking, Cost & Performance Optimization • Skilled leading and/or participating in system design and architectural activities including technical requirement writing experience and ability to lead collaboration sessions for important design reviews and decisions. • Proven experience succeeding in complex, matrix and cross-functional projects • Ability to personally deliver large scale initiatives in a fast-paced environment with high levels of complexity and ambiguity • Experience and comfort managing indirect teams; scrums, agile cross functional teams, vendor stakeholders • Strong collaboration skills and the ability to work in a team-based environment including employees, vendors and third-party contractors • Ability to inspire, influence and collaborate across a wide range of constituents across functions and organizational levels • Excellent mentoring skills and the desire to contribute to efforts beyond the scope of the day-to-day project work • Excellent written, presentation and oral communication skills • Knowledge of technical architecture as a role discipline
Good to have, but not mandatory: • Experience working with Loyalty Management data, and other Marketing business processes data • Experience with Campaign Management, Customer Data Platforms, Content Management, Advertising Technology, Personalization Engines as a Solution, etc., Tech Skills:
Data Engineering Lead (Marketing) • Microsoft Azure Cloud: Azure Data Factory, APIM, Function Apps, Logic Apps, Key Vault, Azure App Insights, Azure SQL, Azure DevOps • Databases: Azure SQL, Databricks, MongoDB, • DevOps: GitHub, Azure DevOps, CI/CD Pipelines • Programming Languages: SQL, PYTHON, SCALA, R • API Development: Azure APIM, REST APIs, web services, security such as Oauth2, SAML, IDM, open API standards like swaggers, RAML, developer portal, • API Testing: Postman, • Log Analytics: Splunk, Dynatrace • Web/Mobile App Analytics: Google Analytics, Firebase, Google Tag management • Architecture modeling: Lucid Chart, Visio, ARIS, etc., • Software development Experience using SaFe Agile methodologies.
Location: Atlanta, GA
Duration: FULL TIME / C2H
Mode: Hybrid ( 2 days a Week)
This Data Engineering Lead (Marketing) position is part of Client IT's Marketing Technology team focused on enabling the development and roll-out of world-class modern Marketing Data Engineering capabilities at Client. This role partners with teams responsible for Marketing and Digital Guest Engagement platforms that leverage world-class technology to create personalized, relevant, data-driven experiences. In this role, you will lead teams designing and building Data & BI solutions that capture, explore, transform, and utilize curated data to support Marketing Business Unit's Data-driven transformation journey and decision-making process. In addition to leading the design and implementation of data products, you will also mentor and develop a team of contingent worker data engineers onsite and offshore.
Duties and Responsibilities: (Scope of the role, day to day activities, expected outcomes, highlights any complexities associated with the role)
Thought Leadership (20%) • Provides industry thought leadership to fellow team members across business and technical project dimensions, solving complex business requirements. • Proactively considers the future state of the organization and how technology can support these efforts. • Advocates and define Marketing Data Engineering vision from a strategic perspective, including internal and external platforms, tools, and systems. • Maintains overall MarTech industry Data knowledge on latest trends, technology, etc. • Mentoring (20%) Manage and lead a technical team responsible for data engineering and analysis. • focusing on individual's professional development as well as overall team health and technical proficiency on their assigned project tasks. • Conducts product work reviews with team members. • Serves in the development of team members by actively facilitating new learning opportunities and experiences in the Data Engineering space.
Development (20%) • Design and implement scalable data solutions on Azure platform using Data Factory, Databricks, PySpark, Python and other related services. • Build data pipelines and workflows to ingest, transform, and load data from various sources. • Develop and maintain data models and schemas for efficient data storage and retrieval. • Develop and maintain CI/CD pipelines for automated deployment and testing of data solutions. • Lead development and production deployment of analytic Data and BI products (also potentially pilots and proof of concepts), determining appropriate design strategies and methodologies.
Collaborations (20%) • Collaborate and maintain relationships with cross-functional teams (Cloud Infra, Enterprise Data & IT-SEC) to ensure data solutions meet business requirements. • Continuously evaluate and recommend new data technologies and approaches to improve data solutions. • Develop business partnerships and influence priorities by identifying solutions that are aligned with current business objectives and closely follow industry trends; understanding how to apply them and sharing knowledge with coworkers. • Communicate with partners, describing technology concepts in ways the business can understand, documenting initiatives in a concise and clear manner. • Partner with Enterprise Data management & information security colleagues to ensure the adherence of Data Governance standards for Client. • Data Engineering Lead (Marketing)
Delivery Management (20%) • Find creative solutions to challenging problems involving factors with potentially broad implications; reflecting on solutions, measuring impact, and using that information to ideate and optimize. • Execute data strategies with an understanding of enterprise architecture, consumption patterns, platforms and application infrastructure. • Stay ahead of the impediments to ensure a smooth, on time and in budget, implementation of Data Projects • Collect weekly status updates from Dev teams across multiple Data POD teams and consolidate for leadership project health reporting.
Work Experience/ Education: (Required work experience and education / preferred experience and education that is beneficial to the role. Work experience can include management experience or any functional expertise where proficiency is necessary to be successful in the role) • Bachelor's degree in computer science, Information Technology or a related study, or equivalent experience • 5+ years of hands-on Data Engineering experience with On-Prem and Cloud based Data tools/Platforms, • 3+ years of experience in data engineering with expertise specifically in Azure Data Factory, Databricks, PySpark, Python and related services. • Proven experience in leading and managing technical teams in data engineering and analysis. • Experience in designing and developing data models and schemas. • Strong proficiency in programming languages such as Python. • Experience in developing and maintaining CI/CD pipelines for automated deployment and testing. • Good understanding of cloud computing and its services (e.g., Azure, AWS, GCP). • Excellent problem-solving skills and ability to work in a fast-paced environment. • Experience with the some of the following concepts: Real-time & Batch Data Processing, Workload Orchestration, Cloud, Data lakes, Data Security, Networking, Serverless, Testing / Test Automation (Unit, Integration, Performance, etc.), WebServices, DevOps, Logging, Monitoring, and Alerting, Containerization, Encryption / Decryption, Data Masking, Cost & Performance Optimization • Skilled leading and/or participating in system design and architectural activities including technical requirement writing experience and ability to lead collaboration sessions for important design reviews and decisions. • Proven experience succeeding in complex, matrix and cross-functional projects • Ability to personally deliver large scale initiatives in a fast-paced environment with high levels of complexity and ambiguity • Experience and comfort managing indirect teams; scrums, agile cross functional teams, vendor stakeholders • Strong collaboration skills and the ability to work in a team-based environment including employees, vendors and third-party contractors • Ability to inspire, influence and collaborate across a wide range of constituents across functions and organizational levels • Excellent mentoring skills and the desire to contribute to efforts beyond the scope of the day-to-day project work • Excellent written, presentation and oral communication skills • Knowledge of technical architecture as a role discipline
Good to have, but not mandatory: • Experience working with Loyalty Management data, and other Marketing business processes data • Experience with Campaign Management, Customer Data Platforms, Content Management, Advertising Technology, Personalization Engines as a Solution, etc., Tech Skills:
Data Engineering Lead (Marketing) • Microsoft Azure Cloud: Azure Data Factory, APIM, Function Apps, Logic Apps, Key Vault, Azure App Insights, Azure SQL, Azure DevOps • Databases: Azure SQL, Databricks, MongoDB, • DevOps: GitHub, Azure DevOps, CI/CD Pipelines • Programming Languages: SQL, PYTHON, SCALA, R • API Development: Azure APIM, REST APIs, web services, security such as Oauth2, SAML, IDM, open API standards like swaggers, RAML, developer portal, • API Testing: Postman, • Log Analytics: Splunk, Dynatrace • Web/Mobile App Analytics: Google Analytics, Firebase, Google Tag management • Architecture modeling: Lucid Chart, Visio, ARIS, etc., • Software development Experience using SaFe Agile methodologies.