Azure DevOps Platform Administrator with Databricks Experience

At USEReady,We empower people to succeed with data. USEReady is a data and analytics firm that provides the strategies, tools, capability and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud and data ecosystem leaders like Tableau, Salesforce, Snowflake and Amazon Web Services, and has been named Tableau partner of the year multiple times.Headquartered in NYC, the company has 600+ employees across offices in the U.S., Canada, Singapore and India and specializes in financial services. USEReadys deep analytics expertise, unique player/coach approach and focus on fast results makes the company a perfect partner for a cloud-first, digital world.Job Title : Azure DevOps AdministratorLocation : NYCJob Type : Long term ContractExperience. As an Azure Databricks Administrator within this department, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal performance and security across workspaces, clusters, and jobs. This role is crucial in overseeing user administration, managing Azure storage solutions, and implementing CI/CD pipelines using Azure DevOps. By leveraging a deep understanding of Databricks architecture and proficiency in scripting languages, the administrator will automate tasks and enhance the efficiency of data operations. Strong communication skills and a commitment to high-quality support will enable effective collaboration with cross-functional teams, directly contributing to the department's mission of delivering robust data solutions and insightsJob ResponsibilitiesManage and maintain Azure Databricks Platform, workspaces, clusters, and jobsOversee user administration including access controls and permissionsHandle library installations, runtime management, and policy enforcementImplement/analyze cost control measures and monitor platform usage and performanceAdminister Unity Catalog for data governance and securityCollaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, and analytical pipelines on the Databricks platformManage Azure storage solutions, including Blob Storage and Data Lake StorageAdminister Azure Key Vault for secure storage of secrets and keysConfigure and manage Azure Data Factory for data integration and ETL processesImplement and manage VNETs, firewalls, Azure policies and security best practicesImplement and manage Azure DevOps for CI/CD pipelines and version controlImplement best practices for automated deployment and continuous integrationSet up budgets and alerts to monitor and control Azure costs and spendImplement monitoring solutions for platform health and performanceConfigure alerts for proactive issue detection and resolutionDatabricks Lakehouse MonitoringMinimum QualificationsMinimum of Bachelor's degree in Computer science, Information systems, or Engineering7+ years of related professional experience administering data platforms3+ years experience with Azure Databricks Lakehouse PlatformProficiency in scripting languages such as Python/PySpark, PowerShell, or BashExperience in automating administrative tasks and workflowsKnowledge of security best practices and compliance requirementsExperience with ETL processes, data pipelines, and big data technologiesExperience with backup and restore procedures for Databricks and Azure servicesAbility to troubleshoot and resolve issues in a timely and efficient mannerStrong verbal and written communication skillsAbility to document processes, procedures, and configurations clearlyCommitment to providing high-quality support to internal/external users and stakeholdersAbility to understand and address the needs of internal and external customersTeam player with the ability to work collaboratively with cross-functional teamsFlexibility to adapt to changing requirements and prioritiesWillingness to learn new technologies and continuously improve skillsPreferred QualificationsDeep understanding of Databricks architecture, features, and best practicesExperience with Delta Lake and Databricks SQL for advanced data managementExperience in performance tuning and optimization for both Databricks and Azure environmentsExperience supporting/administering data science and ML workloads in DatabricksKnowledge of disaster recovery planning and implementationExperience integrating Databricks with other data platforms and toolsUnderstanding of hybrid and multi-cloud environmentsExperience implementing data protection measures and ensuring regulatory compliance