Resource Informatics Group
Data Lakehouse Engineer
Resource Informatics Group, Houston, Texas, United States, 77246
Job Title: Data Lakehouse EngineerDuration: 12+ MonthsLocation: Houston, TX
JOB DESCRIPTIONWe are currently seeking an experienced Data Engineer to join the Big Data and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for Gathering, Processing, and Transformation business units.
Responsibilities include:Design and implement reliable data pipelines to integrate disparate data sources into a single Data LakehouseDesign and implement data quality pipelines to ensure data correctness and building trusted data setsDesign and implement a Data Lakehouse solution which accurately reflects business operationsAssist with data platform performance tuning and physical data model support including partitioning and compactionProvide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectivesThe successful candidate will meet the following qualifications:10+ years of experience as a Data Engineer designing and maintaining data pipeline architecturesExpert knowledge of ANSI SQL, PLSQL, TSQL, and PythonExperience in various data integration patterns including ETL, ELT, Pub/Sub, and Change Data CaptureExperience in data management practices including data catalog, data lineage, and master data managementExperience in business analysis and defining business performance metricsExperience in software development practices such as Design Principles and Patterns, Testing, CI/CD, and version controlExperience in implementing a Data Lakehouse using Apache Iceberg or Delta LakeKnowledgeable of common data visualization tools such as Power BI and Tibco SpotfireExperience with Dremio is preferred
JOB DESCRIPTIONWe are currently seeking an experienced Data Engineer to join the Big Data and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for Gathering, Processing, and Transformation business units.
Responsibilities include:Design and implement reliable data pipelines to integrate disparate data sources into a single Data LakehouseDesign and implement data quality pipelines to ensure data correctness and building trusted data setsDesign and implement a Data Lakehouse solution which accurately reflects business operationsAssist with data platform performance tuning and physical data model support including partitioning and compactionProvide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectivesThe successful candidate will meet the following qualifications:10+ years of experience as a Data Engineer designing and maintaining data pipeline architecturesExpert knowledge of ANSI SQL, PLSQL, TSQL, and PythonExperience in various data integration patterns including ETL, ELT, Pub/Sub, and Change Data CaptureExperience in data management practices including data catalog, data lineage, and master data managementExperience in business analysis and defining business performance metricsExperience in software development practices such as Design Principles and Patterns, Testing, CI/CD, and version controlExperience in implementing a Data Lakehouse using Apache Iceberg or Delta LakeKnowledgeable of common data visualization tools such as Power BI and Tibco SpotfireExperience with Dremio is preferred