Logo
Futran Tech Solutions Pvt. Ltd.

Bigdata Spark Developer

Futran Tech Solutions Pvt. Ltd., Bethesda, Maryland, us, 20811


Bigdata Spark developer

Bethesda, Maryland (Onsite role)

Contract role

JOB SUMMARYSpark Scala knowledge is very important for a big and complex engagement currently being handled. The client is currently setting up AWS DR instance. Underlying tools such as Spark/Scala, Oozie, Postgre and Couchbase. Need a technical team member with hands-on experience to implement and setup big-data eco-system in DR instance.

JOB RESPONSIBILITIES# Create Scala/Spark jobs for data transformation and aggregation# Shall be able to understand and modify the underlying Scala framework as needed# Should be able to understand Spark Streaming jobs and how to work with in-memory Spark state and process messages for near-real time system# Spark query tuning and performance optimization# SQL database integration especially with Postgre and Couchbase# Solve various technical problems in the project in a collaborative manner under specified timeline with minimal guidance and review# Responsible for implementing diverse engineering tasks including gap, data, and impact analysis# Independently perform low-level design configuration, code customization, refactoring and review# Gain expertise and demonstrate high levels of skills in design, review, development, testing, build and deployment stages of the software life cycle# Ensure adequate documentation and provide assistance as a reliable engineer to all stakeholders