JobRialto
Senior Data Engineer
JobRialto, Cincinnati, Ohio, United States, 45208
Description:
We are looking for a Senior Data Engineer to join our dynamic and fast-paced team. The ideal candidate will excel in developing data pipelines, orchestrating data flows, resolving connection issues, solving production problems, and guiding team members. This role is critical in leading the development and design of Supply Chain Data Engineering solutions, maintaining high standards of code quality, and reducing technical debt and vulnerabilities across the project. The candidate should be able to work in a shared service team and handle multiple initiatives simultaneously.
Required Skills:
Technical Skills: Proficiency in Python, PySpark, ADF, SQL, ADLS, Microsoft Azure, Azure Databricks, and Azure Synapse.
GitHub Actions: Experience with setting up and managing CI/CD pipelines using GitHub Actions for smooth and automated deployment processes.
Agile Methodology: Experience in an Agile/Scrum environment, focusing on iterative development, continuous feedback, and delivery.
Qualifications:
Experience: Proven experience in a similar role with a strong track record as a Senior Data Engineer. Minimum 7+ years of experience in delivering high-quality data orchestration solutions and leading development teams.
Key Responsibilities:
Development: Work with various data file formats (Avro, JSON, CSV) using PySpark for ingestion and transformation, Terraform scripting, and DevOps processes.
Lead Development Initiatives: Develop high-quality code and take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards.
Code Quality and Maintenance: Oversee code quality maintenance and enforce best practices, including code reviews, unit testing, CI/CD, and adherence to coding standards.
Reduce Technical Debt: Identify, prioritize, and implement strategies to reduce technical debt and address codebase vulnerabilities.
Team Leadership: Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment.
Collaboration: Work closely with cross-functional teams, including product management, cloud security, LOB, network security, and DevOps, to integrate features into broader solutions.
Problem Solving: Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience.
Documentation: Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance.
Stakeholder Communication: Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives.
Education:
Bachelors Degree
We are looking for a Senior Data Engineer to join our dynamic and fast-paced team. The ideal candidate will excel in developing data pipelines, orchestrating data flows, resolving connection issues, solving production problems, and guiding team members. This role is critical in leading the development and design of Supply Chain Data Engineering solutions, maintaining high standards of code quality, and reducing technical debt and vulnerabilities across the project. The candidate should be able to work in a shared service team and handle multiple initiatives simultaneously.
Required Skills:
Technical Skills: Proficiency in Python, PySpark, ADF, SQL, ADLS, Microsoft Azure, Azure Databricks, and Azure Synapse.
GitHub Actions: Experience with setting up and managing CI/CD pipelines using GitHub Actions for smooth and automated deployment processes.
Agile Methodology: Experience in an Agile/Scrum environment, focusing on iterative development, continuous feedback, and delivery.
Qualifications:
Experience: Proven experience in a similar role with a strong track record as a Senior Data Engineer. Minimum 7+ years of experience in delivering high-quality data orchestration solutions and leading development teams.
Key Responsibilities:
Development: Work with various data file formats (Avro, JSON, CSV) using PySpark for ingestion and transformation, Terraform scripting, and DevOps processes.
Lead Development Initiatives: Develop high-quality code and take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards.
Code Quality and Maintenance: Oversee code quality maintenance and enforce best practices, including code reviews, unit testing, CI/CD, and adherence to coding standards.
Reduce Technical Debt: Identify, prioritize, and implement strategies to reduce technical debt and address codebase vulnerabilities.
Team Leadership: Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment.
Collaboration: Work closely with cross-functional teams, including product management, cloud security, LOB, network security, and DevOps, to integrate features into broader solutions.
Problem Solving: Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience.
Documentation: Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance.
Stakeholder Communication: Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives.
Education:
Bachelors Degree