Insight Global
Lead Data Engineer
Insight Global, Phoenix, Arizona, United States, 85003
Position:
Lead Data EngineerCompany:
A large healthcare companyLocation:
Hybrid 1-2x a week onsite in N. ScottsdaleInterview Process:
2 roundsDuration:
2 year long contractWork authorization:
W2Qualifications:5-7 years of data engineering experienceCapable of leading other data engineers3+ years of experience with Apache Airflow and/or Composer3+ years of experience with DataProc and/or Spark5+ years of experience with CI/CDExperience producing architecture solutions using Composer and SparkExperience in large-scale batch processing with cloud servicesAbility to collaborate with architects to solve problems and provide data engineering solutionsFamiliarity with databases and SQLFamiliarity with at least one OOP language, Java preferredFamiliarity with GCP, GKE, and Cloud IAMExperience working with Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data Stage & Spring BatchOverview of the role:A large healthcare company in Phoenix is looking for a Lead Data Engineer to assist them in solutioning architecture as they transform the Rebate Processing System from its legacy platform. This person will assist their software engineers in rearchitecting, transforming, and designing data pipelines.
Lead Data EngineerCompany:
A large healthcare companyLocation:
Hybrid 1-2x a week onsite in N. ScottsdaleInterview Process:
2 roundsDuration:
2 year long contractWork authorization:
W2Qualifications:5-7 years of data engineering experienceCapable of leading other data engineers3+ years of experience with Apache Airflow and/or Composer3+ years of experience with DataProc and/or Spark5+ years of experience with CI/CDExperience producing architecture solutions using Composer and SparkExperience in large-scale batch processing with cloud servicesAbility to collaborate with architects to solve problems and provide data engineering solutionsFamiliarity with databases and SQLFamiliarity with at least one OOP language, Java preferredFamiliarity with GCP, GKE, and Cloud IAMExperience working with Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data Stage & Spring BatchOverview of the role:A large healthcare company in Phoenix is looking for a Lead Data Engineer to assist them in solutioning architecture as they transform the Rebate Processing System from its legacy platform. This person will assist their software engineers in rearchitecting, transforming, and designing data pipelines.