Virginia Jobs
Data Engineer, Darden School of Business
Virginia Jobs, Charlottesville, Virginia, United States, 22904
The University of Virginia Darden School of Business, one of the world's leading business schools, seeks a highly skilled and motivated
Data Engineer
to join its Strategic IT Data & Analytics team. As a Data Engineer, the role will play a crucial role in building and maintaining our data infrastructure, ensuring the efficient extraction, loading and transformation (ELT) of data from various sources into our cloud data environments.
The ideal candidate should have hands-on experience with ELT processes in Databricks. If you are passionate about data engineering, have strong analytical skills, a passion for higher education and enjoy working in a collaborative environment, we would love to hear from you. While the position is based in Charlottesville, VA, we offer the opportunity for the employee to work remotely for most of the year. However, we do require that the employee be onsite for one week every quarter.
Responsibilities:Develop and implement efficient and scalable metadata-driven data pipelines using cloud-based ELT pipelines to support our data processing and analytics needs.
Collaborate with cross-functional teams, including data analytics developers, functional analysts, and business stakeholders, to understand data requirements and ensure the smooth integration of data sources.
Build models, data integration workflows, and data transformation processes to support data analysis, reporting, and visualization.
Develop, orchestrate, and maintain data pipelines and data processing workflows, ensuring data quality, reliability, and performance.
Develop and maintain continuous integration/continuous deployment (CI/CD) pipelines for data engineering artifacts.
Identify and address performance bottlenecks and data quality issues in collaboration with data operations team.
Monitor and troubleshoot data pipelines to ensure high availability, scalability, and optimal performance.
Develop and maintain integrations between the cloud data platform and the enterprise data governance platform.
Assist in implementing data governance and security measures to ensure compliance with data protection regulations and industry best practices.
Stay current with emerging trends, design patterns and technologies in data engineering and cloud-based data processing to drive continuous improvement and innovation within the organization.
Education and Professional Experience:
Bachelor's degree in Computer Science, MIS, Computer Engineering, Business Administration or related discipline needed with at least five years of professional work experience. Relevant experience may be considered in lieu of a degree. A Master's degree is a plus.
Certification as Databricks Data Engineer Associate or Professional, or demonstrated progress to complete certification within six months of joining.
Proven work experience as a Data Engineer or in a similar role, with a focus on developing and implementing data pipelines and ETL/ELT processes.
Strong proficiency in working with Databricks and Unit strongly preferred.
Experience with metadata-driven ELT processes and data lakehouse architecture.
Demonstrated experience with programming languages to include SQL and Python for data ingestion, transformation, wrangling, modeling and automation.
Demonstrated knowledge and experience working with APIs and web services for data acquisition.
Experience with the Microsoft Azure platform and services. AZ-900 certification is preferred.
Experience integrating Databricks and Unity Catalog with data governance tools, such as Microsoft Purview, and familiarity with data governance, data security, and privacy practices.
Solid understanding of data warehousing concepts, dimensional modeling, and data integration techniques.
Familiarity with continuous integration/continuous deployment (CI/CD) development practices for data engineering workflows.
Strong analytical and problem-solving skills, with the ability to work with large and complex datasets.
Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
Experience with development of artificial intelligence and machine learning workflows is a plus.
Experience with Microsoft Power BI and Microsoft Fabric is a plus.
To Apply:
Apply online using the following link: http://jobs.virginia.edu/us/en/job/R0064969/Data-Engineer-Darden-School-of-Business . Internal applicants must apply through their UVA Workday profile. Complete the application, and upload the following
Required
materials:
Resu me
Cover letter detailing your interest in the position
***Please note that you MUST upload ALL REQUIRED DOCUMENTS into the CV/Resume box, into which multiple documents can be uploaded. Applications that do not contain all of the required documents will not receive full consideration.***
For this position, the selected candidate will need to complete the required background checks prior to the start date of the position.
This position will remain open until filled.
Questions regarding the application process should be directed to Marcus Rozier, Academic Recruiter, at hjv5vm@virginia.edu . The University of Virginia, i ncluding the UVA Health System which represents the UVA Medical Center, Schools of Medicine and Nursing, UVA Physician's Group and the Claude Moore Health Sciences Library, are fundamentally committed to the diversity of our faculty and staff. We believe diversity is excellence expressing itself through every person's perspectives and lived experiences. We are equal opportunity and affirmative action employers. All qualified applicants will receive consideration for employment without regard to age, color, disability, gender identity or expression, marital status, national or ethnic origin, political affiliation, race, religion, sex, pregnancy, sexual orientation, veteran or military status, and family medical or genetic information.
Data Engineer
to join its Strategic IT Data & Analytics team. As a Data Engineer, the role will play a crucial role in building and maintaining our data infrastructure, ensuring the efficient extraction, loading and transformation (ELT) of data from various sources into our cloud data environments.
The ideal candidate should have hands-on experience with ELT processes in Databricks. If you are passionate about data engineering, have strong analytical skills, a passion for higher education and enjoy working in a collaborative environment, we would love to hear from you. While the position is based in Charlottesville, VA, we offer the opportunity for the employee to work remotely for most of the year. However, we do require that the employee be onsite for one week every quarter.
Responsibilities:Develop and implement efficient and scalable metadata-driven data pipelines using cloud-based ELT pipelines to support our data processing and analytics needs.
Collaborate with cross-functional teams, including data analytics developers, functional analysts, and business stakeholders, to understand data requirements and ensure the smooth integration of data sources.
Build models, data integration workflows, and data transformation processes to support data analysis, reporting, and visualization.
Develop, orchestrate, and maintain data pipelines and data processing workflows, ensuring data quality, reliability, and performance.
Develop and maintain continuous integration/continuous deployment (CI/CD) pipelines for data engineering artifacts.
Identify and address performance bottlenecks and data quality issues in collaboration with data operations team.
Monitor and troubleshoot data pipelines to ensure high availability, scalability, and optimal performance.
Develop and maintain integrations between the cloud data platform and the enterprise data governance platform.
Assist in implementing data governance and security measures to ensure compliance with data protection regulations and industry best practices.
Stay current with emerging trends, design patterns and technologies in data engineering and cloud-based data processing to drive continuous improvement and innovation within the organization.
Education and Professional Experience:
Bachelor's degree in Computer Science, MIS, Computer Engineering, Business Administration or related discipline needed with at least five years of professional work experience. Relevant experience may be considered in lieu of a degree. A Master's degree is a plus.
Certification as Databricks Data Engineer Associate or Professional, or demonstrated progress to complete certification within six months of joining.
Proven work experience as a Data Engineer or in a similar role, with a focus on developing and implementing data pipelines and ETL/ELT processes.
Strong proficiency in working with Databricks and Unit strongly preferred.
Experience with metadata-driven ELT processes and data lakehouse architecture.
Demonstrated experience with programming languages to include SQL and Python for data ingestion, transformation, wrangling, modeling and automation.
Demonstrated knowledge and experience working with APIs and web services for data acquisition.
Experience with the Microsoft Azure platform and services. AZ-900 certification is preferred.
Experience integrating Databricks and Unity Catalog with data governance tools, such as Microsoft Purview, and familiarity with data governance, data security, and privacy practices.
Solid understanding of data warehousing concepts, dimensional modeling, and data integration techniques.
Familiarity with continuous integration/continuous deployment (CI/CD) development practices for data engineering workflows.
Strong analytical and problem-solving skills, with the ability to work with large and complex datasets.
Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
Experience with development of artificial intelligence and machine learning workflows is a plus.
Experience with Microsoft Power BI and Microsoft Fabric is a plus.
To Apply:
Apply online using the following link: http://jobs.virginia.edu/us/en/job/R0064969/Data-Engineer-Darden-School-of-Business . Internal applicants must apply through their UVA Workday profile. Complete the application, and upload the following
Required
materials:
Resu me
Cover letter detailing your interest in the position
***Please note that you MUST upload ALL REQUIRED DOCUMENTS into the CV/Resume box, into which multiple documents can be uploaded. Applications that do not contain all of the required documents will not receive full consideration.***
For this position, the selected candidate will need to complete the required background checks prior to the start date of the position.
This position will remain open until filled.
Questions regarding the application process should be directed to Marcus Rozier, Academic Recruiter, at hjv5vm@virginia.edu . The University of Virginia, i ncluding the UVA Health System which represents the UVA Medical Center, Schools of Medicine and Nursing, UVA Physician's Group and the Claude Moore Health Sciences Library, are fundamentally committed to the diversity of our faculty and staff. We believe diversity is excellence expressing itself through every person's perspectives and lived experiences. We are equal opportunity and affirmative action employers. All qualified applicants will receive consideration for employment without regard to age, color, disability, gender identity or expression, marital status, national or ethnic origin, political affiliation, race, religion, sex, pregnancy, sexual orientation, veteran or military status, and family medical or genetic information.