Azure Databricks Architect

Azure Databricks Architect @@@ Atlanta, GA

Job Title:

Data Architect (Azure Databricks)

Location:

Atlanta, GA

Employment Type:

Full-time

Overview:We are seeking an experienced

Data Architect

with deep expertise in

Azure Databricks

to design and implement scalable, high-performance data solutions. The ideal candidate will have strong technical skills in Azure services, Apache Spark, and data processing frameworks, along with a proven ability to architect data pipelines, optimize performance, and ensure data governance.Experience:Proven experience as a

Data Architect

or similar role, with extensive experience designing and implementing solutions on

Azure Databricks

.Technical Skills:

Azure Databricks & Apache Spark

: Proficiency with

Azure Databricks

and

Apache Spark

for big data processing.Azure Services

: Strong experience with Azure services, including

Azure Data Lake

,

Azure Synapse Analytics

, and

Azure SQL

.Data Architecture

: Familiarity with

data modeling

,

ETL processes

, and

data warehousing

concepts.Programming Languages

: Proficiency in programming languages such as

Python

,

Scala

, and

SQL

.Core Skills:

Problem-Solving

: Excellent problem-solving and analytical skills, with a strong focus on optimizing data solutions.Communication

: Strong verbal and written communication skills, with the ability to collaborate effectively with cross-functional teams.Project Management

: Ability to manage multiple projects and prioritize tasks effectively in a fast-paced environment.Preferred Certifications:

Azure Data Engineer

or

Azure Solutions Architect

certifications are preferred but not mandatory.Key Responsibilities:

Architecture Design

:Design and architect

scalable

,

high-performance

data solutions on Azure Databricks, including:

Data pipelines

for ETL/ELT processes.Data lakes

for structured and unstructured data storage.Real-time data processing

systems.

Implementation

:Lead the implementation of Azure Databricks solutions, ensuring

best practices

for performance, security, and data governance are followed.Integration

:Integrate Azure Databricks with other Azure services such as:

Azure Data Lake StorageAzure Synapse AnalyticsAzure SQL Databaselso, integrate with third-party tools and external data sources as required.

Optimization

:Monitor and

optimize data workflows

and queries for performance, reliability, and

cost efficiency

on Azure.Collaboration

:Work closely with

data engineers

,

data scientists

, and

business stakeholders

to understand project requirements and deliver effective data solutions.Governance

:Ensure

data governance

and

security policies

are properly implemented and adhered to within the Databricks environment.Documentation

:Create and maintain comprehensive

documentation

for architectural designs, processes, best practices, and system configurations.Mentorship

:Provide

guidance and mentorship

to junior team members, helping them navigate technical challenges and promoting best practices.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.