Highbrow LLC
Scala and Spark Developer
Highbrow LLC, Austin, Texas, us, 78716
Job Title:
Scala and Spark Developer
Job ID:
2023-12155
Job Location:
Austin, TX; Morris Plains, NJ
Employment Type:
W2
Candidate Constraints:
All Work Authorizations are Permitted – No Visa Transfers
Duration:
Long Term
Key Technology:
Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
Job Responsibilities:
Work with business and technical leadership to understand requirements
Participate in sprint planning sessions and help TPOs
Troubleshooting issues, providing effective solutions and application monitoring in production environments.
Skills and Experience Required:
7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
In-depth knowledge of Hadoop architecture and its components
Strong working knowledge of Single Store (MEMSQL) database
Good hands-on experience working with indexes, shard keys, column store, and reference tables using Single Store database.
Must understand basic AWS services and have hands-on experience
Basic to moderate Terraform development experience needed
Demonstrated work experience in Hadoop, Spark, Hive
Strong hands-on experience in Scala and Spark is a must
Work experience on Hadoop as data warehouse/Data Lake implementations
Strong experience in DevOps pipeline implementation
Health care domain knowledge is a plus
Troubleshooting Hadoop Yarn jobs is a must
Strong experience in writing complex and effective SQLs, and Stored Procedures
Strong development experience in Single Store database operations
Strong profiling skills using Single Store database
Strong query optimization skills to improve the performance of ETL processes
Implement Hadoop job orchestration using Shell scripting and Airflow
Experience in Agile and working knowledge of DevOps tools (Git, Maven, Jenkins, SonarQube, and Checkmarks)
Unix Shell scripting and basic administration of Unix servers
AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch)
Experience in Jira and Confluence
Must participate in production support model.
#J-18808-Ljbffr
Scala and Spark Developer
Job ID:
2023-12155
Job Location:
Austin, TX; Morris Plains, NJ
Employment Type:
W2
Candidate Constraints:
All Work Authorizations are Permitted – No Visa Transfers
Duration:
Long Term
Key Technology:
Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
Job Responsibilities:
Work with business and technical leadership to understand requirements
Participate in sprint planning sessions and help TPOs
Troubleshooting issues, providing effective solutions and application monitoring in production environments.
Skills and Experience Required:
7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
In-depth knowledge of Hadoop architecture and its components
Strong working knowledge of Single Store (MEMSQL) database
Good hands-on experience working with indexes, shard keys, column store, and reference tables using Single Store database.
Must understand basic AWS services and have hands-on experience
Basic to moderate Terraform development experience needed
Demonstrated work experience in Hadoop, Spark, Hive
Strong hands-on experience in Scala and Spark is a must
Work experience on Hadoop as data warehouse/Data Lake implementations
Strong experience in DevOps pipeline implementation
Health care domain knowledge is a plus
Troubleshooting Hadoop Yarn jobs is a must
Strong experience in writing complex and effective SQLs, and Stored Procedures
Strong development experience in Single Store database operations
Strong profiling skills using Single Store database
Strong query optimization skills to improve the performance of ETL processes
Implement Hadoop job orchestration using Shell scripting and Airflow
Experience in Agile and working knowledge of DevOps tools (Git, Maven, Jenkins, SonarQube, and Checkmarks)
Unix Shell scripting and basic administration of Unix servers
AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch)
Experience in Jira and Confluence
Must participate in production support model.
#J-18808-Ljbffr