Spark Scala Developer

Role Description: • 8 years of experience with 5 in big data technologies.• Hands-on development in Spark, Scala and HDFS platforms.• Must have implemented a project on the Python/Java platform.• Strong understanding of distributed computing principles and big data technologies• Java/Python, Apache Spark and Spark SQL, PySpark• Knowledge of data serialization formats such as Parquet, Avro, or ORC• Familiarity with data processing and transformation techniques• Strong knowledge of Scala programming language• Excellent problem-solving and analytical skills• Proficiency in Spark, including the development and optimization of Spark applications• Ability to troubleshoot and debug performance issues in Spark• Understanding of design patterns and data structure for efficient data processing• Experience with database concepts and SQL Competencies: Digital : Apache Spark, Digital : Scala Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.