Spark Consultant

Position: Spark Consultant Location: Rancho Cordova, CA Duration: 9 months The candidate must know the following technologies: Python development Spark cluster configuration and development Oracle SQL development Java & Scala development The candidate must know the following technologies: • Linux server administration • Delta Lake configuration and development • Airflow configuration and development • Microsoft Azure Key Vault configuration and development • Spark cluster configuration and development • Python & Python Spark development • Java & Scala development (nice to have) Candidate responsibilities and duties: • Implement and support Apache Spark (on premise) • Implement Apache Airflow cluster with RabbitMQ and Celery technologies • Implement Azure Key Vault infrastructure and set up Key Vaults for both application development and data warehousing. • Develop custom security modules for Spark Cluster in J Regards, Sangeetha West Advanced Technologies, Inc. Serving government agencies for 22 Years E: sangeetha.pwati.com, D: 279 895 6797 www.wati.com