VDart
Azure Cloud Engineer
VDart, Phoenix, Arizona, United States, 85003
Job Title: Azure Cloud Engineer
Location: Phoenix, AZ-Onsite
Duration: / Term: 6+ months - Contract
Job Description:Develop and maintain data pipelines to ingest, transform, and load data from various sources.Design and manage scalable data lakes to support comprehensive data storage and analysis needs.Design retention, lifecycle, archival policies for datasetsWork with Azure Data Lake Storage to efficiently store and manage large datasets.Create and manage data models and data warehouses to support business intelligence and analytics needs.Set up and manage external tables and integrate with various data sources.Utilize Delta Lake for optimized data storage and real-time analytics capabilities.Develop and deploy interactive and visually compelling reports and dashboards using Power BI.Utilize Azure Databricks for advanced data processing.Optimize and manage Azure SQL databases to ensure high performance and availability.Implement CI/CD pipelines using Azure DevOps to streamline development and deployment processes.Ensure data security and compliance with relevant regulations and best practices (eg: NIST).Setup Azure Purview for data governanceExperience with data integration and migration from on-premises to cloud environments.Proficiency in Python and experience with Python Notebooks.Proficiency in scripting and automation (Power Shell, ARM templates, TerraformAzure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus
Key Skills:
Azure, Cloud, Data Lake, Azure Databricks, Azure SQL
Location: Phoenix, AZ-Onsite
Duration: / Term: 6+ months - Contract
Job Description:Develop and maintain data pipelines to ingest, transform, and load data from various sources.Design and manage scalable data lakes to support comprehensive data storage and analysis needs.Design retention, lifecycle, archival policies for datasetsWork with Azure Data Lake Storage to efficiently store and manage large datasets.Create and manage data models and data warehouses to support business intelligence and analytics needs.Set up and manage external tables and integrate with various data sources.Utilize Delta Lake for optimized data storage and real-time analytics capabilities.Develop and deploy interactive and visually compelling reports and dashboards using Power BI.Utilize Azure Databricks for advanced data processing.Optimize and manage Azure SQL databases to ensure high performance and availability.Implement CI/CD pipelines using Azure DevOps to streamline development and deployment processes.Ensure data security and compliance with relevant regulations and best practices (eg: NIST).Setup Azure Purview for data governanceExperience with data integration and migration from on-premises to cloud environments.Proficiency in Python and experience with Python Notebooks.Proficiency in scripting and automation (Power Shell, ARM templates, TerraformAzure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus
Key Skills:
Azure, Cloud, Data Lake, Azure Databricks, Azure SQL