Logo
Tekwissen

Lead II - Software Engineering

Tekwissen, Deerfield, Illinois, United States, 60063


Overview:

TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client provider of digital technology and transformation, information technology and services

Position: Lead II - Software Engineering

Location: Deerfield IL, Local

Duration: 6 Months

Job Type: Contract

Work Type: Remote

Job Description:

Client is looking for Data Engineers:

Azure Cloud Experience. Data pipeline development, ETL experience, Azure data factory, Azure streams analytics, Azure Blob Storage, Azure data Lake, Batch & real-time data ingestion design and implementation experience, Hadoop, Hive, Cloudera Data Platform Experience, Kafka experience. Agile project experienceResponsibilities:

As a Data Engineer you:Should be able to work with other professionals to ensure successful implementation of proposed designs and completion of projects.Should be responsible for the development, and integration of computer programs.Should understand the business needs and works strictly in compliance with the needs of the client.Requirements:

3-5 years' experience developing data centric applications in Azure3-5 years ETL/ELT development with Azure data tools including Azure Data Factory and Databricks.3-5 years' experience creating data transformation and validation logic within Azure Data Factory using Mapping and Wrangling activities.Advance knowledge of any programming language (Python/PySpark)Advanced knowledge of data formats (JSON, XML, Parquet, etc.) and data modeling practices.Strong knowledge of debugging and performing tuning Azure Data Factory pipelines and runtime environments.Deep understanding of Azure data storage technologies such as Azure Blob Storage, Azure Data Lake Gen2, Synapse, Azure SQL and the frameworks applied to each.Data modelling experience shaping and transforming data into third normal form and dimensional models.Advanced understanding of best practices for structuring and organizing Data Lake file systems for large volumes of data.Knowledge of big-data ecosystems such as Hadoop, Hive, Sqoop, Cloudera Data Platform.Key Skills:

Azure data services, ETL pipeline,Data engineer with - 6-8 yearsRelevant Exp in Data Engineer: 3 yearsMandatory Skills:

Data Engineering,Azure,Azure Data Factory

TekWissen® Group is an equal opportunity employer supporting workforce diversity.