JobRialto
Azure Data Engineer
JobRialto, Cincinnati, Ohio, United States, 45208
Job Summary:
As a Senior Data Engineer, you will support Azure measurement pipelines and workflows for campaign performance.
This role involves developing strategies and solutions to ingest, store, and distribute big data, utilizing various technologies, including PySpark, Hive, JSON, and SQL.
Key Responsibilities:Take ownership of features and drive them to completion through all phases of the 84.51° Software Development Life Cycle (SDLC).Participate in the design and development of Big Data platforms and SQL-based solutions.Conduct unit and integration testing to ensure high-quality deliverables.Collaborate with senior resources to gain insights and improve processes.Participate in retrospective reviews and the estimation process for new work and releases.Innovate and improve processes continuously.Required Qualifications:
Proven experience with Big Data technologies, including Hadoop, Spark (PySpark), and Hive.Understanding of Agile principles (Scrum).Experience developing with Python.Cloud development experience in Azure.Familiarity with Version Control Systems (VCS) such as Git or SVN.Preferred Qualifications:
Experience developing with SQL (Oracle, SQL Server).Exposure to NoSQL databases (e.g., MongoDB, Cassandra).Familiarity with Apache NiFi and Airflow.Experience with Docker.
Education:
Bachelors Degree
As a Senior Data Engineer, you will support Azure measurement pipelines and workflows for campaign performance.
This role involves developing strategies and solutions to ingest, store, and distribute big data, utilizing various technologies, including PySpark, Hive, JSON, and SQL.
Key Responsibilities:Take ownership of features and drive them to completion through all phases of the 84.51° Software Development Life Cycle (SDLC).Participate in the design and development of Big Data platforms and SQL-based solutions.Conduct unit and integration testing to ensure high-quality deliverables.Collaborate with senior resources to gain insights and improve processes.Participate in retrospective reviews and the estimation process for new work and releases.Innovate and improve processes continuously.Required Qualifications:
Proven experience with Big Data technologies, including Hadoop, Spark (PySpark), and Hive.Understanding of Agile principles (Scrum).Experience developing with Python.Cloud development experience in Azure.Familiarity with Version Control Systems (VCS) such as Git or SVN.Preferred Qualifications:
Experience developing with SQL (Oracle, SQL Server).Exposure to NoSQL databases (e.g., MongoDB, Cassandra).Familiarity with Apache NiFi and Airflow.Experience with Docker.
Education:
Bachelors Degree