Diverse Lynx
Snowflake Data Engineer
Diverse Lynx, Chicago, Illinois, United States, 60290
Snowflake Data EngineerChicago-IL Hybrid with 3 days in office
Snowflake Data Engineer
Key Responsibilities:
Data Pipeline Development:Design, build, and manage data pipelines for the ETL process, using Airflow for orchestration and Python for scripting, to transform raw data into a format suitable for our new Snowflake data model.Data Integration:Implement and maintain data synchronization between on-premises Oracle databases and Snowflake using CDC tools.Support Data Modeling:Assist in developing and optimizing the data model for Snowflake, ensuring it supports our analytics and reporting requirements.Reporting Support:Collaborate with data architect to ensure the data within Snowflake is structured in a way that supports efficient and insightful reporting.Technical Documentation:Create and maintain comprehensive documentation of data pipelines, ETL processes, and data models to ensure best practices are followed and knowledge is shared within the team.Qualifications
Experience: Total 10+ years of experience as data engineer; proven experience as a Snowflake data engineer for 5+ years.Skills: Strong knowledge of SQL writing complex queries, performance tuning, Strong experience with
Oracle, Snowflake, ETL /ELT toolsData engineering: proven track record of developing and maintaining data pipelines and data integration projectsOrchestration Tools: Experience in Airflow for managing data pipeline workflows.Programming: proficiency in
Python
and
SQL
for data processing tasks.Data Modeling : Understanding of data modeling principles and experience with data warehousing solutions.Cloud Platforms: Knowledge of cloud infrastructure and services, preferably
Azure , as it relates to Snowflake integration.Collaboration Tools: Experience with version control systems (like Git) and collaboration platforms.CI/CD Implementation: Utilize CI/CD tools to automate the deployment of
data pipelines
and infrastructure changes, ensuring high-quality data processing with minimal manual intervention.Communication: Excellent communication and teamwork skills, with a detail-oriented mindset. Strong analytical skills, with the ability to work independently and solve complex problems.Certifications:
Snowflake certification is a plus.Education: Bachelor's degree in Computer Science, Information Technology, or a related field.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Snowflake Data Engineer
Key Responsibilities:
Data Pipeline Development:Design, build, and manage data pipelines for the ETL process, using Airflow for orchestration and Python for scripting, to transform raw data into a format suitable for our new Snowflake data model.Data Integration:Implement and maintain data synchronization between on-premises Oracle databases and Snowflake using CDC tools.Support Data Modeling:Assist in developing and optimizing the data model for Snowflake, ensuring it supports our analytics and reporting requirements.Reporting Support:Collaborate with data architect to ensure the data within Snowflake is structured in a way that supports efficient and insightful reporting.Technical Documentation:Create and maintain comprehensive documentation of data pipelines, ETL processes, and data models to ensure best practices are followed and knowledge is shared within the team.Qualifications
Experience: Total 10+ years of experience as data engineer; proven experience as a Snowflake data engineer for 5+ years.Skills: Strong knowledge of SQL writing complex queries, performance tuning, Strong experience with
Oracle, Snowflake, ETL /ELT toolsData engineering: proven track record of developing and maintaining data pipelines and data integration projectsOrchestration Tools: Experience in Airflow for managing data pipeline workflows.Programming: proficiency in
Python
and
SQL
for data processing tasks.Data Modeling : Understanding of data modeling principles and experience with data warehousing solutions.Cloud Platforms: Knowledge of cloud infrastructure and services, preferably
Azure , as it relates to Snowflake integration.Collaboration Tools: Experience with version control systems (like Git) and collaboration platforms.CI/CD Implementation: Utilize CI/CD tools to automate the deployment of
data pipelines
and infrastructure changes, ensuring high-quality data processing with minimal manual intervention.Communication: Excellent communication and teamwork skills, with a detail-oriented mindset. Strong analytical skills, with the ability to work independently and solve complex problems.Certifications:
Snowflake certification is a plus.Education: Bachelor's degree in Computer Science, Information Technology, or a related field.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.