JobRialto
Data Quality Analyst Job at JobRialto in Chicago
JobRialto, Chicago, IL, United States
Job Summary
We are seeking a highly skilled Data Quality Analyst with 4-6 years of experience to develop and execute comprehensive data validation tests, ensuring the quality and accuracy of data pipelines, reports, dashboards, and ETL processes in both on-premises and cloud environments. This role focuses on automating testing, improving data quality processes, and working closely with data engineers to address defects and improve data flows.
Key Responsibilities
•Develop and execute test plans, test cases, and scripts for validating data pipelines, BI reports, dashboards, ETL processes, schemas, tables, stored procedures, queries, and jobs across data lakes, data warehouses, and cloud environments.
•Perform thorough data quality checks, including completeness, accuracy, consistency, and timeliness.
•Identify, document, and track data defects, working with data engineers (ETL developers) to resolve issues.
•Lead and execute Data Quality Assurance testing, including manual and automated testing and test data generation for various systems such as Data Lakes, Data Warehouse models (Star Schemas), ETL processes, and reports.
•Develop automated test scripts using Python, SQL, or cloud-native testing frameworks.
•Integrate automated tests into CI/CD pipelines to ensure continuous testing and monitoring of data quality in real-time.
•Maintain and enhance the automation framework to adapt to changing data requirements.
•Generate reports on data quality metrics, test coverage, and defect rates, providing insights to drive continuous improvement.
•Develop dashboards and visualizations to track data quality trends over time.
Required Qualifications
•5+ years' experience in SQL, Python, or other scripting languages used for data testing and data test automation.
•Direct experience with cloud-based data services such as Azure DevOps, Azure Blob Storage, Azure Data Factory, Cloud Power, etc.
•Experience with CI/CD tools (Jenkins, GitLab, etc.) and integrating testing into deployment pipelines.
•Solid understanding of data quality frameworks and tools.
Preferred Qualifications
•Familiarity with Data Lake and Data Warehouse models (Star Schemas).
•Experience with BI tools and reporting frameworks.
•Knowledge of automated testing frameworks.
•Experience in ETL testing and defect management.
Education: Bachelors Degree
We are seeking a highly skilled Data Quality Analyst with 4-6 years of experience to develop and execute comprehensive data validation tests, ensuring the quality and accuracy of data pipelines, reports, dashboards, and ETL processes in both on-premises and cloud environments. This role focuses on automating testing, improving data quality processes, and working closely with data engineers to address defects and improve data flows.
Key Responsibilities
•Develop and execute test plans, test cases, and scripts for validating data pipelines, BI reports, dashboards, ETL processes, schemas, tables, stored procedures, queries, and jobs across data lakes, data warehouses, and cloud environments.
•Perform thorough data quality checks, including completeness, accuracy, consistency, and timeliness.
•Identify, document, and track data defects, working with data engineers (ETL developers) to resolve issues.
•Lead and execute Data Quality Assurance testing, including manual and automated testing and test data generation for various systems such as Data Lakes, Data Warehouse models (Star Schemas), ETL processes, and reports.
•Develop automated test scripts using Python, SQL, or cloud-native testing frameworks.
•Integrate automated tests into CI/CD pipelines to ensure continuous testing and monitoring of data quality in real-time.
•Maintain and enhance the automation framework to adapt to changing data requirements.
•Generate reports on data quality metrics, test coverage, and defect rates, providing insights to drive continuous improvement.
•Develop dashboards and visualizations to track data quality trends over time.
Required Qualifications
•5+ years' experience in SQL, Python, or other scripting languages used for data testing and data test automation.
•Direct experience with cloud-based data services such as Azure DevOps, Azure Blob Storage, Azure Data Factory, Cloud Power, etc.
•Experience with CI/CD tools (Jenkins, GitLab, etc.) and integrating testing into deployment pipelines.
•Solid understanding of data quality frameworks and tools.
Preferred Qualifications
•Familiarity with Data Lake and Data Warehouse models (Star Schemas).
•Experience with BI tools and reporting frameworks.
•Knowledge of automated testing frameworks.
•Experience in ETL testing and defect management.
Education: Bachelors Degree