Ampcus
Hadoop Framework Developer - Data Quality
Ampcus, Chicago, Illinois, United States, 60290
Job Title -
Hadoop Framework Developer - Data Quality
Location - Chicago, IL (Hybrid)Duration - 12 Months
Key Responsibilities:
Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. You will play a crucial role in ensuring the accuracy, consistency, and reliability of large-scale data across our organization.Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.Basic Qualifications:
A minimum of 3 years of experience with Hadoop FrameworkA minimum of 3 years of experience with ETL ProcessingA minimum of 3 years of experience with SparkAssociate's DegreePreferred Qualifications:
Experience with PythonExperience with DataExperience with Hive
Hadoop Framework Developer - Data Quality
Location - Chicago, IL (Hybrid)Duration - 12 Months
Key Responsibilities:
Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. You will play a crucial role in ensuring the accuracy, consistency, and reliability of large-scale data across our organization.Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.Basic Qualifications:
A minimum of 3 years of experience with Hadoop FrameworkA minimum of 3 years of experience with ETL ProcessingA minimum of 3 years of experience with SparkAssociate's DegreePreferred Qualifications:
Experience with PythonExperience with DataExperience with Hive