Logo
ShiftCode Analytics

Data Engineer

ShiftCode Analytics, San Francisco, California, United States, 94199


Interview : F2F interview

Visa : USC, GC, GC EAD, H4, L2

This is hybrid from day -1. Must be local.

Description :

It is with Client Loyalty. They are building out a scoring engine for their merchants. Very similar to Rewards for issuers.

Data Engineer (2)Downtown San Francisco - Three days in office. T/Th mandatory.12 Month ContractExperience dealing with large volumes of data, from various sources, both structured and unstructured.Ability to triage and talk through performance / scaling issues of dealing with data at scale.Good understanding of how data will be read (file formats, partitioning, bucketing).Extensive experience writing testable jobs using Spark (or equivalent) framework.Programming & Scripting Languages: Java EE, Scala, Spark, SQL, Bash.Software Architectures (micro-services, event driven, peer-to-peer).Application Security.Asynchronous Pub-Sub and Point to Point Messaging Systems.Streaming within the Hadoop ecosystem is a plus.