Logo
Diverse Lynx

Azure Databricks Lead

Diverse Lynx, Atlanta, Georgia, United States, 30383


We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data engineering and analytics initiatives. You will collaborate closely with cross-functional teams to understand business requirements, design scalable data solutions, and lead the execution of projects.Technical Leadership: Lead the design, development, and implementation of Azure Databricks solutions, ensuring alignment with business objectives and best practices.Architecture and Design: Architect robust and scalable data pipelines and analytics solutions on Azure Databricks, leveraging services such as Apache Spark, Delta Lake, and MLflow.Data Engineering: Develop ETL processes, data ingestion pipelines, and data transformations to support data integration and analytics requirements.Performance Optimization: Optimize Azure Databricks workloads for performance, reliability, and cost-efficiency, utilizing techniques such as partitioning, caching, and resource management.Collaboration: Collaborate with data scientists, analysts, and business stakeholders to understand requirements, translate them into technical solutions, and deliver actionable insights.Mentorship and Training: Provide guidance, mentorship, and technical expertise to team members, fostering a culture of continuous learning and development.Documentation and Best Practices: Document architecture, design decisions, and technical guidelines, ensuring adherence to best practices and standards.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.