Big Data Developer

Role name: Developer Role Description: Design high quality deliverables adhering to business requirement with defined standards and design principles, patternsDevelop and maintain highly scalable, high performance Data transformation applications using Apache Spark frameworkDevelop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/JavaProvide solutions to Big data problems dealing with huge volumes of data using Spark based data transformation solutions , Hive, MPP processes like IMPALA.Create Junit tests and ensure code coverage is met as per the agreed standardsShould be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors. Experience (Years): 4-6 Essential Skills: Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scriptingShould be comfortable with Unix File system as well as HDFS commandsShould have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DBShould be flexibleShould have good communication and customer management skills Desirable Skills: Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.Should be aware of the components in Big Data ecosystem.Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer. Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.