Hadoop Administrator

Job Title:

Senior Software EngineerExperience:

8 – 11 yearsLocation:

SFO/ HoustonPrimary Skills:

Set up production Hadoop clusters with optimum configurationsDrive automation of Hadoop deployments, cluster expansion and maintenance operationsManage Hadoop cluster, monitoring alerts and notificationDeployment of upgrades, updates and patchesProvide 24x7 tier-3 troubleshooting and break-fix support for production servicesDiagnosis of installation & configuration issuesDiagnosis of cluster management issuesDiagnosis of performance issuesJob scheduling, monitoring, debugging and troubleshootingMonitoring and management of the cluster in all respects, notably availability, performance and securityFile system management and monitoringData transfer between Hadoop and other data stores (incl. relational database)Ingesting additional data sources into Hadoop in either streaming or batch modeCommissioning and decommissioning worker nodesConfiguring the cluster to be rack-awareSet up High Availability/Disaster Recovery environmentDebug/Troubleshoot environment failures/downtimeWorking with data delivery teams to setup new Hadoop users, including setting up Linux users, Kerberos principals, and testing HDFS, Hive, Pig, and MapReduce access for new usersSet up security configurations in HadoopPerformance tuning of Hadoop clusters and Hadoop Map Reduce routinesManage and review Hadoop log filesQualifications

Engineering Graduate, MCA, Masters/Post Graduates (preferably IT/ CS)

#J-18808-Ljbffr