ETL Developer / Data Engineer

ROLE - ETL Developer / Data Engineer LOCATION - Remote MAIN SKILLS - Coding Python/ Pyspark/ Scala, Have strong experience building data pipeline, Exp with Big data frameworks: Spark, Cloud data exp- AWS Responsibilities Develop, debug and enhance large-scale ETL batch jobs that transforms large amounts of data Develop utilities and toolkits to speed up engineering tasks and consolidate repetitive manual tasks executed by engineers while performing data investigations Programming in at least one of the following languages: Java, Python, Scala Required Skills Programming language - Python, Java, or Scala Familiarity with Git or similar version control system Good understanding of data processing concepts and data engineering process. Able to frequently collaborate closely with a diverse tight-knit team Experience investigating and/or debugging problems Able to track, analyze, and report issues in a timely manner Attention to detail and a commitment to quality, while delivering work on schedule Highly organized and efficient Flexibility to respond and react to changing priorities quickly and efficiently Excellent oral and written communication in English Highly Desired Skills Big data processing, e.g. Spark/Hadoop Cloud based services, e.g. AWS Workflow management tools, e.g. Apache Airflow SQL QA/QE