Info Way Solutions
Scala & Spark Developer
Info Way Solutions, Austin, Texas, 78716
Scala & Spark Developer Location- Sunnyvale, CA / Austin, TX No of position : 3 Job Description: 5 - 7 years of overall experience. 4 years of experience of building and supporting scalable Big Data applications. Working in a software product development organisation building modern and scalable pipelines and delivering data promptly in a collaborative team environment. Proficiency in Hadoop technologies and Big Data processing technologies, e.g. Spark, YARN, HDFS, Oozie, Hive, Airflow. Shell scrpting. Strong and exceptional knowledge of Spark Engine, Spark and Scala. Hands on experience with data processing technologies, ETL processes and feature engineering Expertise in Data Analytics, PL/SQL, NoSQL. Strong analytical and troubleshooting skills. Strong interpersonal skills and ability to work effectively across multiple business and technical teams Excellent oral and written communication skills Ability to independently learn new technologies. Passionate, team player and fast leaner. Additional Nice to Have: Experience in commonly used cloud services. Expertise in columnar storage such as Parquet, Iceberg. Knowledge in deep learning models