AustinPPS
Azure Databricks and PowerBI Engineer
AustinPPS, Frisco, Texas, United States, 75034
Job Description
The Azure Databricks Engineer implements and manages the operational aspects of cloud-native and hybrid data platform solutions built with Azure Databricks. Candidates for this role should understand all concepts covered in Azure Data Engineer Associate, Azure Database Administrator Associate, Microsoft Azure Data Fundamentals, and Power BI Data Analyst Associate certifications. Candidate will provide expertise and ownership of Azure Databricks development tasks within the scrum team, as well as expertise in PowerBI and data analysis. The candidate will interact effectively with clients and leadership, adapting communication for the appropriate audience. Responsibilities include reading and comprehending software requirements, assisting with the development of agile user stories and tasks, troubleshooting configuration and performance issues, and assisting with Azure Databricks deployments, testing, configuration, and installation. The candidate will ensure security is a priority, understand security vulnerabilities with database technologies, and ensure database resiliency and disaster recovery capabilities. Comprehensive understanding of backups, restores, redundancy, geo-replication, and Azure storage concepts is required. The candidate will also create detailed documentation for the database and facilitate knowledge sharing within the team for effective collaboration. Essential Skills and Experience Required: Required Qualifications: 5+ years proven experience working with Azure Databricks Analytics database capabilities, specifically Azure Databricks and other relational database technologies supported in Azure. 5+ years proven experience with Azure Data Lake Storage Gen 2, Azure Databricks, Azure Data Explorer, Azure Event Hubs, Spark Pools, Python, PySpark, SQL, Azure Landing Zone, Azure Networking Services, Microsoft EntraID. 5+ years proven experience with Azure geo-redundancy, HA/failover technologies. 5+ years proven experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Data Lakehouse. 5+ years proven experience with Infrastructure as Code (IaC) tools such as Terraform. 5+ years proven experience with programming languages such as Python, PySpark, and data constructs such as JSON or XML. 3+ years PowerBI experience. Understanding of implementing Medallion Architecture using Azure Services. Strong experience with relational and/or dimensional data modeling. Excellent problem-solving skills and a proactive approach to identifying and resolving issues. Strong teamwork and communication skills, with the ability to collaborate effectively with cross-functional teams. The candidate must be a U.S. Citizen or current Green Card holder for at least 3 years and must be able to perform work within the continental United States. Position may require some travel within the United States. Preferred Qualifications: Experience in large scale cloud data migrations using Databricks, Python, Spark, SQL. Understanding of Azure DevOps tools in an Azure production setting. Strong experience with Azure Data Studio, Visual Studio database management/projects/design capabilities, Azure CLI, and PowerShell. Strong and current familiarity with Azure platforms and services, including Azure App Services, Azure API Management, Azure Monitor, Azure Application Insights, Azure SQL, etc. Experience with CI/CD pipelines and deployment automation using tools like Azure DevOps. Experience with Agile methodologies. Strong understanding of security best practices for Azure database deployments, including access controls, IAM, data encryption (TDE), Azure key vaults, and masking. Awareness of FedRAMP, FISMA, and/or Zero Trust Architecture strongly desired. Experience with SQL Server versions 2005 – 2022 is a plus. Experience with Oracle or Microsoft SQL Server, either in Azure or on-prem, is a plus. Preferred Certifications: Azure Data Engineer Associate Azure Database Administrator Associate Azure Data Fundamentals Power BI Data Analyst Associate Company Description: AustinPPS delivers simple technical and business solutions for complex organizations and systems.
#J-18808-Ljbffr
The Azure Databricks Engineer implements and manages the operational aspects of cloud-native and hybrid data platform solutions built with Azure Databricks. Candidates for this role should understand all concepts covered in Azure Data Engineer Associate, Azure Database Administrator Associate, Microsoft Azure Data Fundamentals, and Power BI Data Analyst Associate certifications. Candidate will provide expertise and ownership of Azure Databricks development tasks within the scrum team, as well as expertise in PowerBI and data analysis. The candidate will interact effectively with clients and leadership, adapting communication for the appropriate audience. Responsibilities include reading and comprehending software requirements, assisting with the development of agile user stories and tasks, troubleshooting configuration and performance issues, and assisting with Azure Databricks deployments, testing, configuration, and installation. The candidate will ensure security is a priority, understand security vulnerabilities with database technologies, and ensure database resiliency and disaster recovery capabilities. Comprehensive understanding of backups, restores, redundancy, geo-replication, and Azure storage concepts is required. The candidate will also create detailed documentation for the database and facilitate knowledge sharing within the team for effective collaboration. Essential Skills and Experience Required: Required Qualifications: 5+ years proven experience working with Azure Databricks Analytics database capabilities, specifically Azure Databricks and other relational database technologies supported in Azure. 5+ years proven experience with Azure Data Lake Storage Gen 2, Azure Databricks, Azure Data Explorer, Azure Event Hubs, Spark Pools, Python, PySpark, SQL, Azure Landing Zone, Azure Networking Services, Microsoft EntraID. 5+ years proven experience with Azure geo-redundancy, HA/failover technologies. 5+ years proven experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Data Lakehouse. 5+ years proven experience with Infrastructure as Code (IaC) tools such as Terraform. 5+ years proven experience with programming languages such as Python, PySpark, and data constructs such as JSON or XML. 3+ years PowerBI experience. Understanding of implementing Medallion Architecture using Azure Services. Strong experience with relational and/or dimensional data modeling. Excellent problem-solving skills and a proactive approach to identifying and resolving issues. Strong teamwork and communication skills, with the ability to collaborate effectively with cross-functional teams. The candidate must be a U.S. Citizen or current Green Card holder for at least 3 years and must be able to perform work within the continental United States. Position may require some travel within the United States. Preferred Qualifications: Experience in large scale cloud data migrations using Databricks, Python, Spark, SQL. Understanding of Azure DevOps tools in an Azure production setting. Strong experience with Azure Data Studio, Visual Studio database management/projects/design capabilities, Azure CLI, and PowerShell. Strong and current familiarity with Azure platforms and services, including Azure App Services, Azure API Management, Azure Monitor, Azure Application Insights, Azure SQL, etc. Experience with CI/CD pipelines and deployment automation using tools like Azure DevOps. Experience with Agile methodologies. Strong understanding of security best practices for Azure database deployments, including access controls, IAM, data encryption (TDE), Azure key vaults, and masking. Awareness of FedRAMP, FISMA, and/or Zero Trust Architecture strongly desired. Experience with SQL Server versions 2005 – 2022 is a plus. Experience with Oracle or Microsoft SQL Server, either in Azure or on-prem, is a plus. Preferred Certifications: Azure Data Engineer Associate Azure Database Administrator Associate Azure Data Fundamentals Power BI Data Analyst Associate Company Description: AustinPPS delivers simple technical and business solutions for complex organizations and systems.
#J-18808-Ljbffr