Medica
Lead Data Engineer
Medica, Minnetonka, Minnesota, United States, 55345
As a Lead Data Engineer, you work in a team who strengthens data engineering to support agile growth. Engineer and build the data warehouse and ODS to manage increased demand from analytics and other consumers. Enable transitions to open source, machine learning and Cloud technology based on a solid data foundation. Consult with Domain Data Architects, Business Stakeholders, Data and Application Integration, solution architect and DBA.
This role is responsible for converting Medica’s data architecture into physical designs, implementing and maintaining data structures and processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources. You will design and develop robust, scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable efficient, cost-effective consumption and analysis of data. Support in designing Data solution to support cloud Data strategy evolution. You can write complex SQL or programs and mentor technical and business users about our data. You may evaluate and recommend tools and technologies for data infrastructure and processing.
This role is involved in these areas:Understand business and technical requirements.Convert logical data models to physical data models, DDL, roles and views.Create and update data architecture designs and data flows for subject areas impacted by a program/project. Create source to target documents for ETL developers and ensure an efficient design.Work with BAs and Business SMEs on program/projects to understand requirements and identify non-functional requirements that will impact the data design.Actively engaged as core member of scrum teams to deliver on data programs/projects.Work with ETL and QA to ensure all requirements are met by the solution.Work with DBAs to tune performance.Experience with Cloud, Snowflake databases, ADLS, Python.
Required:BS in Computer Science or related field. An MS is a plus.8+ years of experience in software development and database applications with a majority of this experience in data strategy, sourcing, modeling, integration, and architecture.
What you bring:Business Intelligence / Data Warehousing methodology.Proficiency in SQL and Oracle PL/SQL.Evaluate, analyze, design, and implement solutions based on technical requirements.Extensive experience creating data warehouses, data marts, and operational system databases.Demonstrated ability to have successfully completed multiple, complex technical projects and create high-level design and architecture of the solution, including class, sequence, and deployment infrastructure diagrams.Skilled in data analysis, data profiling, data integration, and data quality.Data modeling for logical, physical, dimensional, and relational 3NF models.Advanced knowledge of SQL, query tuning, RDBMS, and Query tools. Database performance tuning.Strong implementation experience and deep knowledge in any one of the following three areas and knowledge of the other 2 areas at a minimum. Implementation experience in all the 3 areas preferred: ETL, Data Integration, Data Governance and Data Quality.Experience with any modern RDBMS with 3NF and Dimensional design. Strong SQL skills and familiarity with executing DDL. Query and database performance tuning is a plus.Strong knowledge of cloud Datawarehouse/ Snowflake.Must have experience at least with two / one end to end implementation of Snowflake cloud data warehouse.Expertise in Snowflake – data modelling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL concepts.Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero copy clone, time travel and understand how to use these features.Experience with concepts Snowflake utilities, SnowSQL, SnowPipe.Experience partnering with cloud platform vendors, Microsoft Azure and/or AWS.Healthcare experience is very desirable, especially payer knowledge of member, enrollment, claims and provider data.
Additional Qualifications:CDMP (certified data management professional) or CBIP (certified business intelligence professional) is nice to have.Experience with any of ERwin, ER Studio, PowerDesigner.Experience with Informatica (preferred), Data Stage, or Microsoft SSIS/SSRS when used with a defined SDLC in a large, structured work process.Certification in Agile methodology and ITIL foundations is a plus.In depth experience in running data initiatives using agile methodology preferred.Prior experience in ETL, reporting and analytics, and business intelligence tools is preferred.
This position is a Hub role, which requires an employee to occasionally come onsite to the designated office Minnetonka, MN for applicable heads-up work. Frequency is determined by business need as decided by leadership.
Medica's commitment to diversity, equity and inclusion (DEI) includes unifying our workforce through learning and development, recruitment and retention. We consistently communicate the importance of DEI, celebrate achievements, and seek out community partnerships and diverse suppliers that are representative of everyone in our community. We are developing sustainable programs and investing time, talent and resources to ensure that we are living our values. We are an Equal Opportunity/Affirmative Action employer, where all qualified candidates receive consideration for employment indiscriminate of race, religion, ethnicity, national origin, citizenship, gender, gender identity, sexual orientation, age, veteran status, disability, genetic information, or any other protected characteristic.
#J-18808-Ljbffr
This role is responsible for converting Medica’s data architecture into physical designs, implementing and maintaining data structures and processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources. You will design and develop robust, scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable efficient, cost-effective consumption and analysis of data. Support in designing Data solution to support cloud Data strategy evolution. You can write complex SQL or programs and mentor technical and business users about our data. You may evaluate and recommend tools and technologies for data infrastructure and processing.
This role is involved in these areas:Understand business and technical requirements.Convert logical data models to physical data models, DDL, roles and views.Create and update data architecture designs and data flows for subject areas impacted by a program/project. Create source to target documents for ETL developers and ensure an efficient design.Work with BAs and Business SMEs on program/projects to understand requirements and identify non-functional requirements that will impact the data design.Actively engaged as core member of scrum teams to deliver on data programs/projects.Work with ETL and QA to ensure all requirements are met by the solution.Work with DBAs to tune performance.Experience with Cloud, Snowflake databases, ADLS, Python.
Required:BS in Computer Science or related field. An MS is a plus.8+ years of experience in software development and database applications with a majority of this experience in data strategy, sourcing, modeling, integration, and architecture.
What you bring:Business Intelligence / Data Warehousing methodology.Proficiency in SQL and Oracle PL/SQL.Evaluate, analyze, design, and implement solutions based on technical requirements.Extensive experience creating data warehouses, data marts, and operational system databases.Demonstrated ability to have successfully completed multiple, complex technical projects and create high-level design and architecture of the solution, including class, sequence, and deployment infrastructure diagrams.Skilled in data analysis, data profiling, data integration, and data quality.Data modeling for logical, physical, dimensional, and relational 3NF models.Advanced knowledge of SQL, query tuning, RDBMS, and Query tools. Database performance tuning.Strong implementation experience and deep knowledge in any one of the following three areas and knowledge of the other 2 areas at a minimum. Implementation experience in all the 3 areas preferred: ETL, Data Integration, Data Governance and Data Quality.Experience with any modern RDBMS with 3NF and Dimensional design. Strong SQL skills and familiarity with executing DDL. Query and database performance tuning is a plus.Strong knowledge of cloud Datawarehouse/ Snowflake.Must have experience at least with two / one end to end implementation of Snowflake cloud data warehouse.Expertise in Snowflake – data modelling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL concepts.Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero copy clone, time travel and understand how to use these features.Experience with concepts Snowflake utilities, SnowSQL, SnowPipe.Experience partnering with cloud platform vendors, Microsoft Azure and/or AWS.Healthcare experience is very desirable, especially payer knowledge of member, enrollment, claims and provider data.
Additional Qualifications:CDMP (certified data management professional) or CBIP (certified business intelligence professional) is nice to have.Experience with any of ERwin, ER Studio, PowerDesigner.Experience with Informatica (preferred), Data Stage, or Microsoft SSIS/SSRS when used with a defined SDLC in a large, structured work process.Certification in Agile methodology and ITIL foundations is a plus.In depth experience in running data initiatives using agile methodology preferred.Prior experience in ETL, reporting and analytics, and business intelligence tools is preferred.
This position is a Hub role, which requires an employee to occasionally come onsite to the designated office Minnetonka, MN for applicable heads-up work. Frequency is determined by business need as decided by leadership.
Medica's commitment to diversity, equity and inclusion (DEI) includes unifying our workforce through learning and development, recruitment and retention. We consistently communicate the importance of DEI, celebrate achievements, and seek out community partnerships and diverse suppliers that are representative of everyone in our community. We are developing sustainable programs and investing time, talent and resources to ensure that we are living our values. We are an Equal Opportunity/Affirmative Action employer, where all qualified candidates receive consideration for employment indiscriminate of race, religion, ethnicity, national origin, citizenship, gender, gender identity, sexual orientation, age, veteran status, disability, genetic information, or any other protected characteristic.
#J-18808-Ljbffr