Futran Tech Solutions Pvt. Ltd.
Java + Databricks developer
Futran Tech Solutions Pvt. Ltd., Weehawken, New Jersey, United States,
Title - Java + Databricks developer
Duration - 9+ Months
Location - Weehawken, NJ (Onsite)
Responsibilities :
Must have skills -
Java, PySpark and Azure Databricks, Azure PaaS experience• 6 to 8 years of IT experience and at least 4+ years in cloud native data engineering solution design/architecture and development.• Strong hands-on expertise in building Data engineering solutions using Java, Apache Spark and Scala.• Deep expertise in Performance tuning and optimization of Java/Spark/Scala programs.• Ability to design and build data engineering tasks using Data bricks framework.• Hands on experience working with Azure Cloud services like Azure Data Factory, Azure Data Lake Storage, Azure Even hub, Azure SQL, Azure Analytical services, Azure Cosmos DB,• Should be able to demonstrate expertise in designing and building efficient and scalable data engineering solutions using Massively Parallel Processing (MPP) architecture.• Micro-batch streaming and continuous streaming process in Databricks for high latency, low latency and ultra-low latency of data accordingly by using inbuilt Apache spark modules.• Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks.• Build data pipelines for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL• Experience in writing HQL queries in Hive Data warehouse and performance tuning of HIVE scripts• Well versed with Relational and Dimensional Modelling techniques like Star, Snowflake Schema, OLTP, OLAP, Normalization, Fact and Dimensional Tables• Proficient in creating Technical Design Documents (TDD).• Familiar with DevOps principles and experience in CD/CI implementations using Azure native services.• Very good customer relationship and stakeholder management skills• Excellent communication and presentation skills.
Duration - 9+ Months
Location - Weehawken, NJ (Onsite)
Responsibilities :
Must have skills -
Java, PySpark and Azure Databricks, Azure PaaS experience• 6 to 8 years of IT experience and at least 4+ years in cloud native data engineering solution design/architecture and development.• Strong hands-on expertise in building Data engineering solutions using Java, Apache Spark and Scala.• Deep expertise in Performance tuning and optimization of Java/Spark/Scala programs.• Ability to design and build data engineering tasks using Data bricks framework.• Hands on experience working with Azure Cloud services like Azure Data Factory, Azure Data Lake Storage, Azure Even hub, Azure SQL, Azure Analytical services, Azure Cosmos DB,• Should be able to demonstrate expertise in designing and building efficient and scalable data engineering solutions using Massively Parallel Processing (MPP) architecture.• Micro-batch streaming and continuous streaming process in Databricks for high latency, low latency and ultra-low latency of data accordingly by using inbuilt Apache spark modules.• Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks.• Build data pipelines for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL• Experience in writing HQL queries in Hive Data warehouse and performance tuning of HIVE scripts• Well versed with Relational and Dimensional Modelling techniques like Star, Snowflake Schema, OLTP, OLAP, Normalization, Fact and Dimensional Tables• Proficient in creating Technical Design Documents (TDD).• Familiar with DevOps principles and experience in CD/CI implementations using Azure native services.• Very good customer relationship and stakeholder management skills• Excellent communication and presentation skills.