Hadoop ETL Developer

Hadoop ETL Developer with Hadoop and other Software as a Service (Saas) experience:BS Degree in Computer Science or equivalent5 years of extensive IT experience with Java, map reduce ETLMinimum 4 years of experience with Hadoop, developing Big Data / Hadoop applications .Languages : Java and scriptingUnix/Linux Environment- scripting skillsHortonworks or Cloudera commercial release experienceStreaming ingest (JSON entities) over HTTPS utilizing FlumeBatch ingest of Domain data into HBASE utilizing SFTPExcellent working experience with the Hadoop Ecosystem including MapReduce, HDFS, Sqoop, Pig scripts, Hive, HBase, Flume, Impala, Kafka, Spark, Oozie and ZookeeperExperience with distributed systems, large scale non-relational data stores, MapReduce systems, data modeling, and big data systems.Experience in writing MapReduce programs & UDFs for both Hive & Pig in Java. time periods analysis, aggregates, OLTP analysis, churn analysisSTORM Topologies implementation experienceExperience with Hive queries, pig Latin scripts, and MapReduce programs for data analysis and to process the data and loading into databases for visualization.Experience in working with agile methodologies and suggesting process improvements in agile.Expert knowledge in Trouble shooting and performance tuning at various levels such as source, mapping, target and sessions.Experience with performing real time analytics on NoSQL databases like HBase and Cassandra.Experience working with Oozie workflow engine to schedule time based jobs to perform multiple actions.Experience with importing and exporting data from Relational databases to HDFS, Hive and HBase using Sqoop.Used Flume to channel data from different sources to HDFS.RDBMS Experience Oracle, SQLServer, MySQLExperience writing Apache Spark API or Impala on Big Data distribution in the active cluster environment.Experience coding and testing the Standardization, Normalization, Load, Extract and AVRO models to filter/massage the data and its validation.Open stack or AWS experience preferredEqual Opportunity Employer

Cloud Big Data Technologies is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Big Data Technologies will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Big Data Technologies require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

#J-18808-Ljbffr