Stott and May
Senior Azure Data Engineer (Manager) – Remote/White Plains, NY
Stott and May, White Plains, New York, United States
Senior Azure Data Engineer (Manager) – Remote/White Plains, NY
Skills
– Data Engineering, Senior Data Engineer, Hands On, Azure, Azure Databricks, Azure Data Factory, Data Lakes, Management, Data Warehouse, Project Delivery, Communication Skills
My client, a leading Global brand within the CPG industry, is currently looking to onboard a Senior Azure Data Engineer. The ideal individual will have a proven and strong hands-on background within Azure, Azure Databricks, Azure Data Factory, and building data lakes.
This is a Full-Time position which will see individuals working remotely 2-3 days per week, with the remaining 2-3 days on-site at my client’s offices in White Plains, NY.
The Role/Core Responsibilities: As the Data Engineer, you will be directly responsible for the availability, quality, and reliability of data to meet business data needs across the organization. The primary focus of this role will revolve around data warehouse maintenance in MS Azure. As a Senior Azure Data Engineer, you will design, build, and maintain the data infrastructure to ensure seamless integration of internal and external systems and smooth data flow. Work closely with the business to deliver complex data integrations and projects to meet client needs from a data perspective. Design, build, and maintain data pipelines using tools such as Azure Data Factory, Databricks, Azure Synapse, SQL, and Python. Oversee the creation of data pipelines and data marts in real-time, near real-time, and batch processing. Ensure accurate and efficient integration of a large variety (structured, semi-structured, and unstructured) of data from various sources. Own and manage all data warehouse deliverables, such as data models, ETL/ELT processes, and data quality assessments. Ensure consistent adherence to data warehouse architecture standards through governance, best practices, and automation. Manage the day-to-day operations of the Azure data, Power BI, and UC4 platforms. Monitor, audit, and measure data warehouse performance and recommend improvements. Manage the data lake environment, including blob storage. Guide the development and implementation of procedures for the maintenance and monitoring of data warehouse and related systems. Ensure the availability, performance, and scalability of the data warehouse platform, including data pipelines, security controls, administration tools, and warehouse database.
The Candidate: 8+ years of experience in data warehousing, data modeling, and data transformation. Proven hands-on and extensive experience with Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage (ADLS). Strong grasp of data ingestion, transformation, and delivery (ETL/ELT) processes. Expert knowledge of SQL Server environments for designing and developing databases. Highly proficient in PySpark and SQL. Experience working with Power BI dataflows and job scheduling platform UC4 is beneficial. Extensive experience working with complex systems to retrieve, analyze, and synthesize data. Proven ability to communicate complex technical processes and data concepts in an understandable manner to business stakeholders. Prior experience implementing end-to-end data pipelines for large datasets using cloud and on-premise stacks.
Salary – $150k-$170k Per Annum + Bonus (20%) + Benefits
Please send resumes directly to
patrick.hindmarsh@stottandmay.com
and we can look to run through the specifics.
I look forward to hearing from you.
#J-18808-Ljbffr
Skills
– Data Engineering, Senior Data Engineer, Hands On, Azure, Azure Databricks, Azure Data Factory, Data Lakes, Management, Data Warehouse, Project Delivery, Communication Skills
My client, a leading Global brand within the CPG industry, is currently looking to onboard a Senior Azure Data Engineer. The ideal individual will have a proven and strong hands-on background within Azure, Azure Databricks, Azure Data Factory, and building data lakes.
This is a Full-Time position which will see individuals working remotely 2-3 days per week, with the remaining 2-3 days on-site at my client’s offices in White Plains, NY.
The Role/Core Responsibilities: As the Data Engineer, you will be directly responsible for the availability, quality, and reliability of data to meet business data needs across the organization. The primary focus of this role will revolve around data warehouse maintenance in MS Azure. As a Senior Azure Data Engineer, you will design, build, and maintain the data infrastructure to ensure seamless integration of internal and external systems and smooth data flow. Work closely with the business to deliver complex data integrations and projects to meet client needs from a data perspective. Design, build, and maintain data pipelines using tools such as Azure Data Factory, Databricks, Azure Synapse, SQL, and Python. Oversee the creation of data pipelines and data marts in real-time, near real-time, and batch processing. Ensure accurate and efficient integration of a large variety (structured, semi-structured, and unstructured) of data from various sources. Own and manage all data warehouse deliverables, such as data models, ETL/ELT processes, and data quality assessments. Ensure consistent adherence to data warehouse architecture standards through governance, best practices, and automation. Manage the day-to-day operations of the Azure data, Power BI, and UC4 platforms. Monitor, audit, and measure data warehouse performance and recommend improvements. Manage the data lake environment, including blob storage. Guide the development and implementation of procedures for the maintenance and monitoring of data warehouse and related systems. Ensure the availability, performance, and scalability of the data warehouse platform, including data pipelines, security controls, administration tools, and warehouse database.
The Candidate: 8+ years of experience in data warehousing, data modeling, and data transformation. Proven hands-on and extensive experience with Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage (ADLS). Strong grasp of data ingestion, transformation, and delivery (ETL/ELT) processes. Expert knowledge of SQL Server environments for designing and developing databases. Highly proficient in PySpark and SQL. Experience working with Power BI dataflows and job scheduling platform UC4 is beneficial. Extensive experience working with complex systems to retrieve, analyze, and synthesize data. Proven ability to communicate complex technical processes and data concepts in an understandable manner to business stakeholders. Prior experience implementing end-to-end data pipelines for large datasets using cloud and on-premise stacks.
Salary – $150k-$170k Per Annum + Bonus (20%) + Benefits
Please send resumes directly to
patrick.hindmarsh@stottandmay.com
and we can look to run through the specifics.
I look forward to hearing from you.
#J-18808-Ljbffr