JobRialto
ADF ETL Engineer
JobRialto, Tampa, Florida, us, 33646
Job Summary:
We are seeking an experienced Senior Data Engineer for a contract-to-hire position with a State of Arkansas Medicaid Decision Support System project. The role involves backfilling an ETL person and supporting the transition of all ETL processes from Informatica and SQL to Azure Data Factory (ADF) and Snowflake as the primary database. You will be part of the Center of Excellence (CoE), working in a remote, highly collaborative environment with a team of data engineers, modelers, and architects. The ideal candidate will have extensive experience in ETL development, particularly with Azure Data Factory, Snowflake, and healthcare datasets.
Key Responsibilities:
ETL Development:
Design and build data pipelines in Azure Data Factory (ADF) to move and transform data from multiple sources.
Migrate existing Informatica/SQL ETL processes to ADF and Snowflake as the target database.
Data Engineering:
Analyze project requirements and develop specifications for ETL and data pipeline development.
Collaborate with data architects and engineers to ensure integration of data solutions into the broader Enterprise Data Warehouse (EDW).
Collaboration:
Work closely with other team members (data engineers, modelers, architects) in a cross-functional environment to ensure the timely and successful completion of data engineering tasks.
Participate in team meetings to align on project goals, timelines, and deliverables.
Technology & Tools:
Develop and maintain ETL workflows, using SQL, Azure Data Factory, and Snowflake to ensure smooth data integration and transformation.
Ensure best practices are followed in data modeling and ETL design.
Healthcare Focus:
Work with large healthcare datasets and ensure solutions are tailored to meet the unique needs of state-level Medicaid/Medicare systems.
Required Qualifications:
Experience: 5+ years of data engineering experience, with a strong focus on data warehousing. 2+ years of hands-on experience creating ETL pipelines in Azure Data Factory (ADF). 5+ years of experience developing ETL processes using tools such as Informatica PowerCenter, SSIS, or Azure Data Factory. Technical Skills:
Strong proficiency in SQL for data querying and transformation. Experience with Snowflake as a data warehouse, including the development of APIs and integrations. Ability to design and implement data models for complex data environments. Preferred Qualifications:
Additional Skills:
2+ years of experience with batch scripting or PowerShell scripting for process automation. 2+ years of experience with Python scripting. 3+ years of data modeling experience within a data warehouse environment. Experience with Informatica Intelligent Cloud Services (specifically Data Integration). Experience designing and building APIs in Snowflake and ADF (REST, RPC). Familiarity with State Medicaid/Medicare/Healthcare applications is a significant plus. Certifications:
Azure certifications related to data engineering or data analytics are preferred.
Certifications:
Azure Data Engineer Associate or Azure Fundamentals (Preferred, but not required). Certified Informatica Developer (Preferred, but not required).
Education:
Bachelors Degree
We are seeking an experienced Senior Data Engineer for a contract-to-hire position with a State of Arkansas Medicaid Decision Support System project. The role involves backfilling an ETL person and supporting the transition of all ETL processes from Informatica and SQL to Azure Data Factory (ADF) and Snowflake as the primary database. You will be part of the Center of Excellence (CoE), working in a remote, highly collaborative environment with a team of data engineers, modelers, and architects. The ideal candidate will have extensive experience in ETL development, particularly with Azure Data Factory, Snowflake, and healthcare datasets.
Key Responsibilities:
ETL Development:
Design and build data pipelines in Azure Data Factory (ADF) to move and transform data from multiple sources.
Migrate existing Informatica/SQL ETL processes to ADF and Snowflake as the target database.
Data Engineering:
Analyze project requirements and develop specifications for ETL and data pipeline development.
Collaborate with data architects and engineers to ensure integration of data solutions into the broader Enterprise Data Warehouse (EDW).
Collaboration:
Work closely with other team members (data engineers, modelers, architects) in a cross-functional environment to ensure the timely and successful completion of data engineering tasks.
Participate in team meetings to align on project goals, timelines, and deliverables.
Technology & Tools:
Develop and maintain ETL workflows, using SQL, Azure Data Factory, and Snowflake to ensure smooth data integration and transformation.
Ensure best practices are followed in data modeling and ETL design.
Healthcare Focus:
Work with large healthcare datasets and ensure solutions are tailored to meet the unique needs of state-level Medicaid/Medicare systems.
Required Qualifications:
Experience: 5+ years of data engineering experience, with a strong focus on data warehousing. 2+ years of hands-on experience creating ETL pipelines in Azure Data Factory (ADF). 5+ years of experience developing ETL processes using tools such as Informatica PowerCenter, SSIS, or Azure Data Factory. Technical Skills:
Strong proficiency in SQL for data querying and transformation. Experience with Snowflake as a data warehouse, including the development of APIs and integrations. Ability to design and implement data models for complex data environments. Preferred Qualifications:
Additional Skills:
2+ years of experience with batch scripting or PowerShell scripting for process automation. 2+ years of experience with Python scripting. 3+ years of data modeling experience within a data warehouse environment. Experience with Informatica Intelligent Cloud Services (specifically Data Integration). Experience designing and building APIs in Snowflake and ADF (REST, RPC). Familiarity with State Medicaid/Medicare/Healthcare applications is a significant plus. Certifications:
Azure certifications related to data engineering or data analytics are preferred.
Certifications:
Azure Data Engineer Associate or Azure Fundamentals (Preferred, but not required). Certified Informatica Developer (Preferred, but not required).
Education:
Bachelors Degree