Diverse Lynx
Azure Data Engineer
Diverse Lynx, Yorkville, Ohio, United States, 43971
Role-Azure Data Engineer
Location -Yorkville, TN
Job Type-C2C
Job description Below
Experience in generating data pipelines in Azure ADF •Experience in ingesting data from different Sources using in Azure ADF •Experience in transforming the data using Azure Databricks & Delta lake and Pyspark •Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management •Implement Integration solution in Microsoft Azure •Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues•Experience working in agile development projects and sprint deliver •Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines .•Perform data transformations and cleansing operations to ensure data accuracy and consistency. •Evolve existing scripts and notebooks to meet client needs. •Monitor, troubleshoot, and optimize data pipelines for seamless functionality. •Ensure data solutions align with security and compliance standards •Work closely with data architects to harmonize data models with project objectives. •Document programming efforts and processes, technical specifications, and best practices.
Job description Below
Experience in generating data pipelines in Azure ADF •Experience in ingesting data from different Sources using in Azure ADF •Experience in transforming the data using Azure Databricks & Delta lake and Pyspark •Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management •Implement Integration solution in Microsoft Azure •Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues•Experience working in agile development projects and sprint deliver •Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines .•Perform data transformations and cleansing operations to ensure data accuracy and consistency. •Evolve existing scripts and notebooks to meet client needs. •Monitor, troubleshoot, and optimize data pipelines for seamless functionality. •Ensure data solutions align with security and compliance standards •Work closely with data architects to harmonize data models with project objectives. •Document programming efforts and processes, technical specifications, and best practices.