Logo
Ampcus

Hadoop Framework Developer - Data Quality

Ampcus, Chicago, Illinois, United States, 60290


Job Title -

Hadoop Framework Developer - Data Quality

Location - Chicago, IL (Hybrid)Duration - 12 Months

Key Responsibilities:

Designing, implementing, and maintaining data quality frameworks within our Hadoop ecosystem. You will play a crucial role in ensuring the accuracy, consistency, and reliability of large-scale data across our organization.Designing and developing scalable data quality frameworks and tools using Hadoop technologies such as MapReduce, Hive, Pig, and Spark.Implementing automated data quality checks and validations to ensure data integrity throughout the ETL processes.Optimizing Hadoop jobs and data processing workflows for efficiency, reliability, and scalability.Basic Qualifications:

A minimum of 3 years of experience with Hadoop FrameworkA minimum of 3 years of experience with ETL ProcessingA minimum of 3 years of experience with SparkAssociate's DegreePreferred Qualifications:

Experience with PythonExperience with DataExperience with Hive