BigData Engineer

9 yrs IT experience and good expertise in SDLC/Agile 5 yrs in Big Data technologies Hadoop, AWS, Python, Scala, Kafka, Spark etc Mandatory: Good listing skills to understand business objectives and collaborate well with team and business partners Proficient in data consolidation/flattening, optimizing 'Big-Data' pipelines, architecture, and large data sets. Hands on experience in writing complex queries on data sets in Hadoop and mongoDB Good experience in implementing Kafka, spark streaming, Mongo db and Shell scripting Hands on experience in migrating Hadoop on-prem to cloud AWS/Snowflake Enable/recommend proactive measures to enhance data quality and improve SLA of Production components