Logo
Info Way Solutions

Scala & Spark Developer

Info Way Solutions, Austin, Texas, 78716


Scala & Spark Developer Location- Sunnyvale, CA / Austin, TX No of position : 3 Job Description: 5 - 7 years of overall experience. 4 years of experience of building and supporting scalable Big Data applications. Working in a software product development organisation building modern and scalable pipelines and delivering data promptly in a collaborative team environment. Proficiency in Hadoop technologies and Big Data processing technologies, e.g. Spark, YARN, HDFS, Oozie, Hive, Airflow. Shell scrpting. Strong and exceptional knowledge of Spark Engine, Spark and Scala. Hands on experience with data processing technologies, ETL processes and feature engineering Expertise in Data Analytics, PL/SQL, NoSQL. Strong analytical and troubleshooting skills. Strong interpersonal skills and ability to work effectively across multiple business and technical teams Excellent oral and written communication skills Ability to independently learn new technologies. Passionate, team player and fast leaner. Additional Nice to Have: Experience in commonly used cloud services. Expertise in columnar storage such as Parquet, Iceberg. Knowledge in deep learning models