Dice
DATA Engineer with Spark & Scala
Dice, Bloomfield, Connecticut, us, 06002
Role: Data Engineer with Spark & ScalaLocation: Bloomfield, CT (DAY-1 onsite)Mandatory skills:SparkScalaDatabricksAWS CloudResponsibilities:8+ years of experience as a Data or Software Engineer developing with production code.Proven track record of delivering solid, scalable, and innovative solutions.A strong understanding of data infrastructure and related technologies.Experience with data modelling, data warehousing, and building end-to-end ETL pipelines.Proficiency in Scala.Deep understanding and experience with Apache Spark and related (DataFrame/Dataset) APIs.Working knowledge of different data storage formats (parquet, avro, json).Advanced SQL experience.Experience with the Databricks platform.Advanced experience in one or more scripting languages (shell, YAML, etc).CI/CD experience with Terraform, GitLab CI, Docker.Experience with search technologies - Open Search.Experience with AWS cloud technologies (S3, DynamoDB, RDS, Lambda).Streaming and event-based system design.Disclaimer:
E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO/AA/M/F/Vet/Disability.
#J-18808-Ljbffr
E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO/AA/M/F/Vet/Disability.
#J-18808-Ljbffr