Infogain Corp
Azure Data Engineer (Lead)
Infogain Corp, Houston, Texas, United States, 77246
Azure Data Engineer (Lead)
Location: Bangalore, IndiaResponsibilities:Design, develop, and maintain ETL pipelines using Databricks, PySpark, and Azure Data Factory (ADF) to extract, transform, and load data from various sources.Demonstrate strong skills in PySpark, programming, and code remediation.Work with Delta tables, perform deduplication, and merge large datasets (terabytes).Optimize and fine-tune existing ETL workflows for performance and scalability.Have 2 to 3 years of experience in ADF (medium expertise required).Experience working with large datasets.Proficient in SQL, with experience in complex joins, subqueries, functions, and procedures.Be self-driven and able to work independently without support.Experience
8-11 YearsSkills
Primary Skill: Data EngineeringAbout the Company
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives across various industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. Infogain is a Microsoft Gold Partner and Azure Expert Managed Services Provider.
#J-18808-Ljbffr
Location: Bangalore, IndiaResponsibilities:Design, develop, and maintain ETL pipelines using Databricks, PySpark, and Azure Data Factory (ADF) to extract, transform, and load data from various sources.Demonstrate strong skills in PySpark, programming, and code remediation.Work with Delta tables, perform deduplication, and merge large datasets (terabytes).Optimize and fine-tune existing ETL workflows for performance and scalability.Have 2 to 3 years of experience in ADF (medium expertise required).Experience working with large datasets.Proficient in SQL, with experience in complex joins, subqueries, functions, and procedures.Be self-driven and able to work independently without support.Experience
8-11 YearsSkills
Primary Skill: Data EngineeringAbout the Company
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives across various industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. Infogain is a Microsoft Gold Partner and Azure Expert Managed Services Provider.
#J-18808-Ljbffr