Logo
ASB Resources

Sr Big Data Engineer

ASB Resources, Iselin, New Jersey, us, 08830


Sr Big Data Engineer

8+ yrs IT experience and good expertise in SDLC/Agile 6+ yrs in programing language (Python, Scala, Spark)

Mandatory:

Hands on experience in writing advanced SQL queries, familiarity with variety of database

Tools: - Big-Data, Spark, Python, Scala Experience in building and optimizing 'Big-Data' pipelines, architecture, and data sets

Experience in Hadoop file formats like ORC, Avro, Parquet, CSV

Cloud platform: AWS, Snowflake

Hands on experience in AWS Bigdata env

Desired:

Kafka streaming and Shell scripting

Scheduling tools like Control-M, Oozie

NoSQL databases like MongoDB

Implement Python flex APIs to share data insights to digital systems