Medica
Senior Data Engineer
Medica, Hopkins, Minnesota, United States, 55305
Description
As a Senior Data Engineer, you work in a team who strengthens data engineering to support agile growth. Engineer and build the data warehouse and ODS to manage increased demand from analytics and other consumers. Enable transitions to open source, machine learning and Cloud technology based on a solid data foundation. Consult with Domain Data Architects, Business Stakeholders, Data and Application Integration, solution architect and DBA.
This role is responsible for converting Medica's data architecture into physical designs, implementing and maintaining data structures and processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources. You will design and develop robust, scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable efficient, cost-effective consumption and analysis of data. Support in designing Data solution to support cloud Data strategy evolution. You can write complex SQL or programs and mentor technical and business users about our data. You may evaluate and recommend tools and technologies for data infrastructure and processing.
This role is involved in these areas:
Understand business and technical requirements.
Convert logical data models to physical data models, DDL, roles and views.
Create and update data architecture designs and data flows for subject areas impacted by a program/project. Create source to target documents for ETL developers and ensure an efficient design.
Work with BAs and Business SMEs on program/projects to understand requirements and identify non-functional requirements that will impact the data design.
Actively engaged as core member of scrum teams to deliver on data programs\projects.
Work with ETL and QA to ensure all requirements are met by the solution.
Work with DBA's to tune performance
Experience with Cloud, SnowFlake databases, ADLS, Python
Required:
BS in Computer Science or related field. An MS is a plus.
5 years of experience in software development and database applications with a majority of this experience in data strategy, sourcing, modeling, integration, and architecture.
What you bring:
Business Intelligence / Data Warehousing methodology
Proficiency in SQL, Oracle PL/SQL and Informatica Powercenter/IDMC
Evaluate, analyze, design, and implement solutions based on technical requirements.
Extensive experience creating data warehouses, data marts, and operational system databases.
Demonstrated ability to have successfully completed multiple, complex technical projects and create high-level design and architecture of the solution, including class, sequence and deployment infrastructure diagrams.
Skilled in data analysis, data profiling, data integration, and data quality.
Data modeling for logical, physical, dimensional, and relational 3NF models.
Advanced knowledge of SQL, query tuning, RDBMS, and Query tools. Database performance tuning.
Strong implementation experience and deep knowledge in any one of the following three areas and knowledge of the other 2 areas at a minimum. Implementation experience in all the 3 areas preferred: ETL, Data Integration, Data Governance and Data Quality
Experience with any modern RDBMS with 3NF and Dimensional design. Strong SQL skills and familiarity with executing DDL. Query and database performance tuning is a plus
Strong knowledge of cloud Datawarehouse in particular Snowflake
Must have experience at least with two / one end to end implementation of Snowflake cloud data warehouse.
Expertise in Snowflake - data modelling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL concepts
Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, Zero copy clone, time travel and understand how to use these features
Experience with concepts Snowflake utilities, SnowSQL, SnowPipe
Experience partnering with cloud platform vendors, Microsoft Azure and/or AWS
Healthcare experience is very desirable, especially payer knowledge of member, enrollment, claims and provider data.
In addition to above qualifications, please note:
CDMP (certified data management professional) or CBIP (certified business intelligence professional) is nice to have.
Experience with any of ERwin, ER Studio, PowerDesigner
Experience with Informatica (preferred), Data Stage, or Microsoft SSIS/SSRS when used with a defined SDLC in a large, structured work process.
Certification in Agile methodology and ITIL foundations is a plus.
In depth experience in running data initiatives using agile methodology preferred.
Prior experience in ETL, reporting and analytics, and business intelligence tools is preferred.
The full salary range for this position is $85,000 - $145,700. Annual salary range placement will depend on a variety of factors including, but not limited to, education, work experience, applicable certifications and/or licensure, the position's scope and responsibility, internal pay equity and external market salary data. In addition to compensation, Medica offers a generous total rewards package that includes competitive medical, dental, vision, PTO, Holidays, paid volunteer time off, 401K contributions, caregiver services and many other benefits to support our employees.
The compensation and benefits information is provided as of the date of this posting. Medica's compensation and benefits are subject to change at any time, with or without notice, subject to applicable law.
Medica's commitment to diversity, equity and inclusion (DEI) includes unifying our workforce through learning and development, recruitment and retention. We consistently communicate the importance of DEI, celebrate achievements, and seek out community partnerships and diverse suppliers that are representative of everyone in our community. We are developing sustainable programs and investing time, talent and resources to ensure that we are living our values. We are an Equal Opportunity/Affirmative Action employer, where all qualified candidates receive consideration for employment indiscriminate of race, religion, ethnicity, national origin, citizenship, gender, gender identity, sexual orientation, age, veteran status, disability, genetic information, or any other protected characteristic.Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)
As a Senior Data Engineer, you work in a team who strengthens data engineering to support agile growth. Engineer and build the data warehouse and ODS to manage increased demand from analytics and other consumers. Enable transitions to open source, machine learning and Cloud technology based on a solid data foundation. Consult with Domain Data Architects, Business Stakeholders, Data and Application Integration, solution architect and DBA.
This role is responsible for converting Medica's data architecture into physical designs, implementing and maintaining data structures and processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources. You will design and develop robust, scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable efficient, cost-effective consumption and analysis of data. Support in designing Data solution to support cloud Data strategy evolution. You can write complex SQL or programs and mentor technical and business users about our data. You may evaluate and recommend tools and technologies for data infrastructure and processing.
This role is involved in these areas:
Understand business and technical requirements.
Convert logical data models to physical data models, DDL, roles and views.
Create and update data architecture designs and data flows for subject areas impacted by a program/project. Create source to target documents for ETL developers and ensure an efficient design.
Work with BAs and Business SMEs on program/projects to understand requirements and identify non-functional requirements that will impact the data design.
Actively engaged as core member of scrum teams to deliver on data programs\projects.
Work with ETL and QA to ensure all requirements are met by the solution.
Work with DBA's to tune performance
Experience with Cloud, SnowFlake databases, ADLS, Python
Required:
BS in Computer Science or related field. An MS is a plus.
5 years of experience in software development and database applications with a majority of this experience in data strategy, sourcing, modeling, integration, and architecture.
What you bring:
Business Intelligence / Data Warehousing methodology
Proficiency in SQL, Oracle PL/SQL and Informatica Powercenter/IDMC
Evaluate, analyze, design, and implement solutions based on technical requirements.
Extensive experience creating data warehouses, data marts, and operational system databases.
Demonstrated ability to have successfully completed multiple, complex technical projects and create high-level design and architecture of the solution, including class, sequence and deployment infrastructure diagrams.
Skilled in data analysis, data profiling, data integration, and data quality.
Data modeling for logical, physical, dimensional, and relational 3NF models.
Advanced knowledge of SQL, query tuning, RDBMS, and Query tools. Database performance tuning.
Strong implementation experience and deep knowledge in any one of the following three areas and knowledge of the other 2 areas at a minimum. Implementation experience in all the 3 areas preferred: ETL, Data Integration, Data Governance and Data Quality
Experience with any modern RDBMS with 3NF and Dimensional design. Strong SQL skills and familiarity with executing DDL. Query and database performance tuning is a plus
Strong knowledge of cloud Datawarehouse in particular Snowflake
Must have experience at least with two / one end to end implementation of Snowflake cloud data warehouse.
Expertise in Snowflake - data modelling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL concepts
Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, Zero copy clone, time travel and understand how to use these features
Experience with concepts Snowflake utilities, SnowSQL, SnowPipe
Experience partnering with cloud platform vendors, Microsoft Azure and/or AWS
Healthcare experience is very desirable, especially payer knowledge of member, enrollment, claims and provider data.
In addition to above qualifications, please note:
CDMP (certified data management professional) or CBIP (certified business intelligence professional) is nice to have.
Experience with any of ERwin, ER Studio, PowerDesigner
Experience with Informatica (preferred), Data Stage, or Microsoft SSIS/SSRS when used with a defined SDLC in a large, structured work process.
Certification in Agile methodology and ITIL foundations is a plus.
In depth experience in running data initiatives using agile methodology preferred.
Prior experience in ETL, reporting and analytics, and business intelligence tools is preferred.
The full salary range for this position is $85,000 - $145,700. Annual salary range placement will depend on a variety of factors including, but not limited to, education, work experience, applicable certifications and/or licensure, the position's scope and responsibility, internal pay equity and external market salary data. In addition to compensation, Medica offers a generous total rewards package that includes competitive medical, dental, vision, PTO, Holidays, paid volunteer time off, 401K contributions, caregiver services and many other benefits to support our employees.
The compensation and benefits information is provided as of the date of this posting. Medica's compensation and benefits are subject to change at any time, with or without notice, subject to applicable law.
Medica's commitment to diversity, equity and inclusion (DEI) includes unifying our workforce through learning and development, recruitment and retention. We consistently communicate the importance of DEI, celebrate achievements, and seek out community partnerships and diverse suppliers that are representative of everyone in our community. We are developing sustainable programs and investing time, talent and resources to ensure that we are living our values. We are an Equal Opportunity/Affirmative Action employer, where all qualified candidates receive consideration for employment indiscriminate of race, religion, ethnicity, national origin, citizenship, gender, gender identity, sexual orientation, age, veteran status, disability, genetic information, or any other protected characteristic.Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)