Highbrow LLC
Spark Developer
Highbrow LLC, Morris Plains, New Jersey, us, 07950
Job Title
:
Spark DeveloperJob ID: 2022-11834
Job Location: Morris Plains, NJ (remote to start)
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:
Duration:Long Term
# of Layers:0
Work Eligibility:US Permanent Eligibility to Work Required
Key Technology:
Spark, Scala, Kafka, Hadoop, ETL, SQL
Job Responsibilities:
Working with application owners to understand business needs and create software solutions that meet the needs
Working with other development teams to integrate new features into existing projects
Designing, developing, testing, debugging, documenting, and supporting applications
Coordinating with other team members throughout the development process to ensure that tasks are completed properly and on time
Analyzing data sets to identify patterns and trends that can be used to improve existing products or develop new ones
Following guidelines and standards for developing new applications or improving existing ones
Designing and developing new software applications or improving existing ones
Participating in design meetings with other members of the development team to discuss project details
Work in a scrum team and participate in scrum ceremonies
Skills and Experience Required:
At least 4 years of experience in Scala and Spark (Batch and Structured Streaming) development
Experience building data pipelines using both Spark structured streaming and spark batch processes.
Experience in consuming and producing messages to Kafka topic
Clear understanding of Hadoop Ecosystem & Spark Architecture
Strong understanding of Functional programming and RESTful APIs
Produce unit tests for Spark transformations and helper methods
Experience with design and implementation of ETL framework for complex warehouses, Knowledge of large data sets and experience with performance tuning and troubleshooting.
Strong knowledge and hands-on experience in SQL, Unix shell scripting
#J-18808-Ljbffr
:
Spark DeveloperJob ID: 2022-11834
Job Location: Morris Plains, NJ (remote to start)
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:
Duration:Long Term
# of Layers:0
Work Eligibility:US Permanent Eligibility to Work Required
Key Technology:
Spark, Scala, Kafka, Hadoop, ETL, SQL
Job Responsibilities:
Working with application owners to understand business needs and create software solutions that meet the needs
Working with other development teams to integrate new features into existing projects
Designing, developing, testing, debugging, documenting, and supporting applications
Coordinating with other team members throughout the development process to ensure that tasks are completed properly and on time
Analyzing data sets to identify patterns and trends that can be used to improve existing products or develop new ones
Following guidelines and standards for developing new applications or improving existing ones
Designing and developing new software applications or improving existing ones
Participating in design meetings with other members of the development team to discuss project details
Work in a scrum team and participate in scrum ceremonies
Skills and Experience Required:
At least 4 years of experience in Scala and Spark (Batch and Structured Streaming) development
Experience building data pipelines using both Spark structured streaming and spark batch processes.
Experience in consuming and producing messages to Kafka topic
Clear understanding of Hadoop Ecosystem & Spark Architecture
Strong understanding of Functional programming and RESTful APIs
Produce unit tests for Spark transformations and helper methods
Experience with design and implementation of ETL framework for complex warehouses, Knowledge of large data sets and experience with performance tuning and troubleshooting.
Strong knowledge and hands-on experience in SQL, Unix shell scripting
#J-18808-Ljbffr