Scala / Python Engineer

W2 Only

LOCATION: On site in NYC 4 days/week

Our major streaming client is seeking a Senior Software Engineer - you will be working on building highly resilient and scalable data pipelines which will publish enriched data of transactions into their Data Lake and analytical data warehouses. This role is highly multi-functional and gives the opportunity to work with Product, Information Security, Data, Analytics, Business Operations, Finance, and various other functions across the company as they consume, enrich and publish highly impactful data.

TECH STACK:

1. Scala.

1. Python.

1. Spark.

1. Databricks.

RESPONSIBILITIES:

-Build sophisticated and highly impactful systems

-Write code in Java, Scala, Kotlin, Python, Spark

-Use AWS products and services (EC2, S3, Lambda, DynamoDB, SQS, RDS, ElastiCache, CloudFront, Kinesis etc.)

-Use ETL products like Databricks- critical

-Use Data Warehouses like Snowflake

-Develop RESTful services

-Work with SQL and NoSQL

REQUIRED SKILLS:

• DEGREE REQUIRED IN CS or other Engineering degree

-7+ years of software experience

-Experience in one or more of the following:

-Building large datasets and scalable services

-Deploying and running services in AWS, and engineering big-data solutions using technologies like Databricks, EMR, S3, Spark

-Container systems such as Docker or Kubernetes

-Drive and maintain a culture of quality, innovation and experimentation

-Work in an Agile environment that focuses on collaboration and teamwork

Additional Information Looking for someone who can work independently as well as in a team dynamic. Looking for previous experience in taking ownership of feature/functionality. Previous experience creating well tested services. Ability to investigate any technical component as well as understand and contribute to overall systems architecture. This is highly sensitive and critical business integration to be supported Critical for revenue reconciliation and recognition.

External Job Posting