Logo
Highbrow LLC

Scala and Spark Developer

Highbrow LLC, Austin, Texas, us, 78716


Job Title:

Scala and Spark Developer

Job ID:

2023-12155

Job Location:

Austin, TX; Morris Plains, NJ

Employment Type:

W2

Candidate Constraints:

All Work Authorizations are Permitted – No Visa Transfers

Duration:

Long Term

Key Technology:

Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop

Job Responsibilities:

Work with business and technical leadership to understand requirements

Participate in sprint planning sessions and help TPOs

Troubleshooting issues, providing effective solutions and application monitoring in production environments.

Skills and Experience Required:

7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop

In-depth knowledge of Hadoop architecture and its components

Strong working knowledge of Single Store (MEMSQL) database

Good hands-on experience working with indexes, shard keys, column store, and reference tables using Single Store database.

Must understand basic AWS services and have hands-on experience

Basic to moderate Terraform development experience needed

Demonstrated work experience in Hadoop, Spark, Hive

Strong hands-on experience in Scala and Spark is a must

Work experience on Hadoop as data warehouse/Data Lake implementations

Strong experience in DevOps pipeline implementation

Health care domain knowledge is a plus

Troubleshooting Hadoop Yarn jobs is a must

Strong experience in writing complex and effective SQLs, and Stored Procedures

Strong development experience in Single Store database operations

Strong profiling skills using Single Store database

Strong query optimization skills to improve the performance of ETL processes

Implement Hadoop job orchestration using Shell scripting and Airflow

Experience in Agile and working knowledge of DevOps tools (Git, Maven, Jenkins, SonarQube, and Checkmarks)

Unix Shell scripting and basic administration of Unix servers

AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch)

Experience in Jira and Confluence

Must participate in production support model.

#J-18808-Ljbffr