Logo
eTeam

Big Data Engineer / Hybrid

eTeam, Richardson, Texas, United States, 75080

Save Job

Must Have Skills Azure, Notebooks, Spark-Scala, Pyspark, Bigdata, Databricks, ControlM

Detailed Job Description

Relevant required 8+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment Participate in design and implementation of the analytics architecture. Experience in working on Hadoop Distribution, good understanding of core concepts and best practices Good experience in building/tuning Spark pipelines in Python/Java/Scala Good experience in writing complex Hive queries to drive business critical insights Understanding of Data Lake vs Data Warehousing concepts Experience with AWS Cloud, exposure to Lambda/EMR/Kinesis will be good to have. Work with multiple teams, arrive at common decision understand architecture principle of organization and provide solution accordingly Minimum years of experience > 10 years

Top 3 responsibilities you would expect and execute

Lead developer provide resolve technical queries, develop queries, work with QA and other team for final implementation Design and development using Azure, Notebooks, SparkScala, Big data. Deliver as per scrumAgile methodology