Diverse Lynx
Azure Databricks Engineer
Diverse Lynx, Louisville, Kentucky, us, 40201
Title: Azure Databricks EngineerLocation:
Louisville, Kentucky
(Onsite)Job Type: Contract
Job Description:• Experience in generating data pipelines in Azure ADF• Experience in ingesting data from different Sources using in Azure ADF• Experience in transforming the data using Azure Databricks & Delta lake and Pyspark• Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management• Implement Integration solution in Microsoft Azure• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues• Experience working in agile development projects and sprint deliver• Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines.• Perform data transformations and cleansing operations to ensure data accuracy and consistency.• Evolve existing scripts and notebooks to meet client needs.• Monitor, troubleshoot, and optimize data pipelines for seamless functionality.• Ensure data solutions align with security and compliance standards• Work closely with data architects to harmonize data models with project objectives.• Document programming efforts and processes, technical specifications, and best practices. mming efforts and processes, technical specifications, and best
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Louisville, Kentucky
(Onsite)Job Type: Contract
Job Description:• Experience in generating data pipelines in Azure ADF• Experience in ingesting data from different Sources using in Azure ADF• Experience in transforming the data using Azure Databricks & Delta lake and Pyspark• Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management• Implement Integration solution in Microsoft Azure• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues• Experience working in agile development projects and sprint deliver• Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines.• Perform data transformations and cleansing operations to ensure data accuracy and consistency.• Evolve existing scripts and notebooks to meet client needs.• Monitor, troubleshoot, and optimize data pipelines for seamless functionality.• Ensure data solutions align with security and compliance standards• Work closely with data architects to harmonize data models with project objectives.• Document programming efforts and processes, technical specifications, and best practices. mming efforts and processes, technical specifications, and best
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.