Insight Global
Data Engineer (Azure Databricks)
Insight Global, Cincinnati, Ohio, United States, 45208
An employer is looking for a Data Engineer for a hybrid, contract-to-hire opportunity in the Cincinnati, Ohio area. The client is a large retail company, and this person will be supporting the Enterprise Supplier Solutions space. They will be brought on to support a platform that has been built out in Azure Data Factory. Need to be very well versed in Databricks with Medallion Architecture - Moving from bronze to silver to gold then serving up in unity catalog. This person will work in a hybrid work environment required to go on site two days per week.
Responsibilities include, but are not limited to:
Develop and implement data pipelines for movement of data through the layers based on team & enterprise standards.
Implement & perform unit testing, system integration testing, regression testing and assist with user acceptance testing.
Adhere to established standards and best practices and provide input for improvement of those processes.
Self-motivated team player who can work with minimal supervision and can adapt to a quickly changing environment.
Ability to work on multiple tasks simultaneously, ability to switch between tasks and work in conflicting priorities.
Tooling & Platforms include, but not limited to: Azure Databricks, Databricks Workflows, Databricks Delta Live Tables, Databricks Unity Catalog, Delta Lake, Azure Data Factory (ingestion & orchestration), ADLS Gen 2, Azure SQL Database, Azure CosmosDB, Neo4j, Apache Spark, PySpark, Spark SQL, SQL, PL/SQPl, Oracle Database Technologies (19c), Kafka, REST APIs, Alation, Terraform
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Oracle Database Technologies
Kafka
Terraform
Databricks Certified Data Engineer Associate4+ years of experience in a Data Engineering role
2-3 years of Hands on Experience working with in Azure Databricks including workflows, Delta Live Tables and Databricks Unity Catalog
Familiarity with ETL/ELT in Databricks and with Medallion architecture
SQL, PySpark, Python
Spark SQL
Responsibilities include, but are not limited to:
Develop and implement data pipelines for movement of data through the layers based on team & enterprise standards.
Implement & perform unit testing, system integration testing, regression testing and assist with user acceptance testing.
Adhere to established standards and best practices and provide input for improvement of those processes.
Self-motivated team player who can work with minimal supervision and can adapt to a quickly changing environment.
Ability to work on multiple tasks simultaneously, ability to switch between tasks and work in conflicting priorities.
Tooling & Platforms include, but not limited to: Azure Databricks, Databricks Workflows, Databricks Delta Live Tables, Databricks Unity Catalog, Delta Lake, Azure Data Factory (ingestion & orchestration), ADLS Gen 2, Azure SQL Database, Azure CosmosDB, Neo4j, Apache Spark, PySpark, Spark SQL, SQL, PL/SQPl, Oracle Database Technologies (19c), Kafka, REST APIs, Alation, Terraform
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Oracle Database Technologies
Kafka
Terraform
Databricks Certified Data Engineer Associate4+ years of experience in a Data Engineering role
2-3 years of Hands on Experience working with in Azure Databricks including workflows, Delta Live Tables and Databricks Unity Catalog
Familiarity with ETL/ELT in Databricks and with Medallion architecture
SQL, PySpark, Python
Spark SQL