Diverse Lynx
Data Engineer
Diverse Lynx, Atlanta, Georgia, United States, 30383
Proficient in Python and PySpark.
Strong knowledge of SQL.Experience in building and optimizing complex data pipelines in Azure.Hand on experience on Azure Databricks.Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log analytics workspace , Service principal, managed identity , ACR and container instances etc.Should possesses knowledge about Azure networking services. •Knowledge on Azure infrastructure creation using ARM templates. • Well versed with GitLab and Azure DevOps.Experience Required 8+ yearsRoles & Responsibilities
Build and maintain data pipelinesBuild and support required Azure Infrastructure - configurations, updates, etc. • Support Data storage and processing frameworkWorking with stakeholders including data, design, productBuild processes that support data transformation, workload management, dependency and metadata
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Strong knowledge of SQL.Experience in building and optimizing complex data pipelines in Azure.Hand on experience on Azure Databricks.Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log analytics workspace , Service principal, managed identity , ACR and container instances etc.Should possesses knowledge about Azure networking services. •Knowledge on Azure infrastructure creation using ARM templates. • Well versed with GitLab and Azure DevOps.Experience Required 8+ yearsRoles & Responsibilities
Build and maintain data pipelinesBuild and support required Azure Infrastructure - configurations, updates, etc. • Support Data storage and processing frameworkWorking with stakeholders including data, design, productBuild processes that support data transformation, workload management, dependency and metadata
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.