TechnoGen
Azure Data Engineer
TechnoGen, Cincinnati, Ohio, United States, 45208
Role: Azure Data Engineer
Location: Cincinnati, OH (Hybrid role)
Job Description:
Requirements:•Experience in Data modeling and advanced SQL techniques•Experience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data services•Expert in SQL, Python, Spark, Databricks•Experience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation•Experience with DevOps process and understanding of Terraform scripting•Understanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design•Experience designing and implementing ingestion processes for unstructured and structured data sets•Experience designing and developing data cleansing routines utilizing standard data operations•Knowledge of data, master data, metadata related standards, and processes•Experience working with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queries•Experience using Azure DevOps/Github actions CI/CD pipelines to deploy code•Microsoft Azure certifications are a plus•Minimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms
Core Technologies•Azure Functions•Python•SQL Server•Azure Data Factory•Azure Databricks•Terraform•Azure DevOps•GitHub / GitHub Actions•T-SQL and SQL stored procedures•Azure Log Analytics•Azure Data Lake Storage•Azure Synapse
Key Responsibilities:
SQL, Python, Spark, DatabricksWorking with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationDevOps process and Terraform scriptingLeadership skills: must be able to put together and deliver presentations.Solid communication while working with PMO. Must be able to translate what the product is asking for and regurgitate to team.
Notes from HM:
This is a Senior level position - right before manager but the HM is really wanting them to eventually be able to run teams, they are looking for leadership skills and someone who is able to jump in and be the leader of the team.
Soft Skills Needed:•Leadership Experience -must have experience managing a team•Collaborative
Location: Cincinnati, OH (Hybrid role)
Job Description:
Requirements:•Experience in Data modeling and advanced SQL techniques•Experience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data services•Expert in SQL, Python, Spark, Databricks•Experience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation•Experience with DevOps process and understanding of Terraform scripting•Understanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design•Experience designing and implementing ingestion processes for unstructured and structured data sets•Experience designing and developing data cleansing routines utilizing standard data operations•Knowledge of data, master data, metadata related standards, and processes•Experience working with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queries•Experience using Azure DevOps/Github actions CI/CD pipelines to deploy code•Microsoft Azure certifications are a plus•Minimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms
Core Technologies•Azure Functions•Python•SQL Server•Azure Data Factory•Azure Databricks•Terraform•Azure DevOps•GitHub / GitHub Actions•T-SQL and SQL stored procedures•Azure Log Analytics•Azure Data Lake Storage•Azure Synapse
Key Responsibilities:
SQL, Python, Spark, DatabricksWorking with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationDevOps process and Terraform scriptingLeadership skills: must be able to put together and deliver presentations.Solid communication while working with PMO. Must be able to translate what the product is asking for and regurgitate to team.
Notes from HM:
This is a Senior level position - right before manager but the HM is really wanting them to eventually be able to run teams, they are looking for leadership skills and someone who is able to jump in and be the leader of the team.
Soft Skills Needed:•Leadership Experience -must have experience managing a team•Collaborative