Diverse Lynx
Azure Databricks Engineer
Diverse Lynx, Louisville, Kentucky, us, 40201
Experience in generating data pipelines in Azure ADFExperience in ingesting data from different Sources using in Azure ADFExperience in transforming the data using Azure Databricks & Delta lake and PysparkExperience in Azure DevOps CI/CD - Stories, Bugs, and Issue managementImplement Integration solution in Microsoft AzurePerforms data analysis required to troubleshoot data related issues and assist in the resolution of data issuesExperience working in agile development projects and sprint deliverCollaborate with cross-functional teams to elicit data requirements and architect effective data pipelines.Perform data transformations and cleansing operations to ensure data accuracy and consistency.Evolve existing scripts and notebooks to meet client needs.Monitor, troubleshoot, and optimize data pipelines for seamless functionality.Ensure data solutions align with security and compliance standardsWork closely with data architects to harmonize data models with project objectives.Document programming efforts and processes, technical specifications, and best practices.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.