Futran Tech Solutions Pvt. Ltd.
Data/Spark Engineer
Futran Tech Solutions Pvt. Ltd., Durham, North Carolina, United States, 27703
Position: Data/Spark Engineer
Location: Durham, NC (day 1 onsite)
Employment: Fulltime
Client: Persistent / Fidelity
Java/Spark Engineer
We are currently sourcing for a Java/Spark Engineer to work in Durham, NC!
The Role
As part of UAP (Unified Acquisition Platform) team you will be working on enhancing the next generation in-house acquisition platform using cloud technologies. UAP will be built using Java Spark and Python programming language and use AWS EMR as the infrastructure for execution. You would be developing lambda, Spark, Python utilities for managing end to end feed flow. We will focus on building tools and capabilities to accelerate acquisition, compare data across vendors, externalize rules for data conversion, build inventory/registry of feeds and track lineage.
You would be focusing on:
Develop new application for managing feed inventory and tracking their usageDeveloping application interface using Java Spark for converting vendor feeds into business-friendly formatDevelop accelerators for new feed acquisitionDevelop accelerators for data comparison reportsDeveloping Lambda triggers for event driven and batch driven use caseSupporting production during warranty periodParticipate in code review and define standard methodologyManage branching and deployments without conflictsProvide L3 production supportEnhancing framework for future needs and make it a more generic product.The Expertise and Skills You Bring
Bachelor in information technology6+ years of experience with application development and hands on experience with Spark/ScalaExpertise in providing leadership support by providing technical solutionsExpertise in handling huge datasetExpertise in code reviews for standards and efficient coding practicesExpertise in building monitoring and alerting tools to report failure or potential performance degradationExperience with TDD (Test driven development) to build unit testing and robust regression test suite
Location: Durham, NC (day 1 onsite)
Employment: Fulltime
Client: Persistent / Fidelity
Java/Spark Engineer
We are currently sourcing for a Java/Spark Engineer to work in Durham, NC!
The Role
As part of UAP (Unified Acquisition Platform) team you will be working on enhancing the next generation in-house acquisition platform using cloud technologies. UAP will be built using Java Spark and Python programming language and use AWS EMR as the infrastructure for execution. You would be developing lambda, Spark, Python utilities for managing end to end feed flow. We will focus on building tools and capabilities to accelerate acquisition, compare data across vendors, externalize rules for data conversion, build inventory/registry of feeds and track lineage.
You would be focusing on:
Develop new application for managing feed inventory and tracking their usageDeveloping application interface using Java Spark for converting vendor feeds into business-friendly formatDevelop accelerators for new feed acquisitionDevelop accelerators for data comparison reportsDeveloping Lambda triggers for event driven and batch driven use caseSupporting production during warranty periodParticipate in code review and define standard methodologyManage branching and deployments without conflictsProvide L3 production supportEnhancing framework for future needs and make it a more generic product.The Expertise and Skills You Bring
Bachelor in information technology6+ years of experience with application development and hands on experience with Spark/ScalaExpertise in providing leadership support by providing technical solutionsExpertise in handling huge datasetExpertise in code reviews for standards and efficient coding practicesExpertise in building monitoring and alerting tools to report failure or potential performance degradationExperience with TDD (Test driven development) to build unit testing and robust regression test suite