Azure Databricks Architect

Azure Databricks Architect Location: REMOTE (USA) Duration: 12 Months Project Overview: We are helping them with a Transformation Initiative where they're trying to bring in data from many disparate ERP Systems, CRM systems, homegrown applications into a unified data and analytics platform which will be Azure Databricks. They are currently using Azure. They have Alation for enterprise cataloging, but they will also leverage a lot of Databricks Unity Catalog features for cataloging. The consumption of the data will be in Power BI and the Power BI Architect will support that piece of the work. Most of these tools are already identified and in place at Hillenbrand from a foundational level. There are 5-6 sub projects that focus on certain domains. Food, Health, and Nutrition (FHN) Corporate Spend Finance Supply Chain, Inventory, and Operations CRM Pipeline Reporting Inventory Dashboarding The initial 2 months would be about assessing their current state, creating repeatable processes, scalability, etc. This person will be the responsible for all the strategy, all the approach, all the best practices, architecture, design principals are being followed as part of the execution. Reason for Role & Team Details : These are new roles that are needed to drive the sub projects. Once the real execution starts, the team will increase to 50-60 people (on and offshore) by Jan/Feb next year. Top Role Requirements : Responsible for designing & developing the data models & design the various layers of the architecture (medallion architecture) to support data integration, storage & access needs of the engagement. This architect will be expected to be VERY hands-on. Expectations from a technology standpoint, you're basically expected to be a technology leader, giving strategy, roadmap direction for everything that we are doing in this program. Understands the services and nuances of Azure. Needs to be thorough in Databricks. This is a critical role that is client facing and this person will be working with the technology stakeholders and some business stakeholders. Technology : Understands the services and nuances of Azure. Needs to be thorough in Databricks. Core Screen Questions to Ask: How do you optimize DBU Consumption cost? How do you migrate Hive metastore to Unity catalog? What should the Access control policy be while using unity catalog? How do you optimize cloud cost and performance while ingesting the data from SAP to Azure cloud storage? If they can t answer these questions above, they won t be strong enough.