Highbrow LLC
Lead AWS Data Bricks Spark/Scala Engineer
Highbrow LLC, Saint Louis, Missouri, United States, 63146
Job Title: Lead AWS Data Bricks Spark/Scala EngineerJob ID: 2022-11882
Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO
Key Technology:
DataBricks, AWS, Spark
Job Responsibilities:
Data Bricks Architect profile with AWS combination.
Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool / framework which includes programming with Spark/Scala
Data Management, Migration experience from other platforms to AWS
Drive mentality of building well architected applications for AWS Cloud
Drive the mentality of quality being owned by the entire team
Identify code defects and work with developers to address quality issues in product code.
Finding bottlenecks and thresholds in existing code through the use of automation tools.
Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily.
Ownership over your work task, and are comfortable interacting with all levels of the team and raise challenges when necessary
Skills and Experience Required:
Required:
10+ years of experience in architecture, design, implementation, and analytics solutions
Hands on development Design and Develop applications using Databricks
Experience with Solutioning on AWS
Data Migration experience from other platforms to AWS
In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
Desired:
Any programming language experience with SQL, Store procedures, Spark/Scala.
Strong understanding of Data Modeling and defining conceptual logical and physical data models.
Ability to design and demonstrate system Architecture with different environments
Ability to deal with both On-Premises and Cloud systems
#J-18808-Ljbffr
Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO
Key Technology:
DataBricks, AWS, Spark
Job Responsibilities:
Data Bricks Architect profile with AWS combination.
Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool / framework which includes programming with Spark/Scala
Data Management, Migration experience from other platforms to AWS
Drive mentality of building well architected applications for AWS Cloud
Drive the mentality of quality being owned by the entire team
Identify code defects and work with developers to address quality issues in product code.
Finding bottlenecks and thresholds in existing code through the use of automation tools.
Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily.
Ownership over your work task, and are comfortable interacting with all levels of the team and raise challenges when necessary
Skills and Experience Required:
Required:
10+ years of experience in architecture, design, implementation, and analytics solutions
Hands on development Design and Develop applications using Databricks
Experience with Solutioning on AWS
Data Migration experience from other platforms to AWS
In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
Desired:
Any programming language experience with SQL, Store procedures, Spark/Scala.
Strong understanding of Data Modeling and defining conceptual logical and physical data models.
Ability to design and demonstrate system Architecture with different environments
Ability to deal with both On-Premises and Cloud systems
#J-18808-Ljbffr