Spark Consultant

Position: Spark Consultant

Location:

Rancho Cordova, CA

Duration: 9 +months

The candidate must know the following technologies:

# Python development # Spark cluster configuration and development

# Oracle SQL development

# Java & Scala development

The candidate must know the following technologies:

• Linux server administration

• Delta Lake configuration and development

• Airflow configuration and development

• Microsoft Azure Key Vault configuration and development

• Spark cluster configuration and development

• Python & Python Spark development

• Java & Scala development (nice to have)

Candidate responsibilities and duties:

• Implement and support Apache Spark (on premise)

• Implement Apache Airflow cluster with RabbitMQ and Celery technologies

• Implement Azure Key Vault infrastructure and set up Key Vaults for both application development and data warehousing.

• Develop custom security modules for Spark Cluster in J

Regards,

Sangeetha

West Advanced Technologies, Inc.

Serving government agencies for 22 Years

E: sangeetha.p@wati.com , D: 279 895 6797

www.wati.com