Senior Azure Data Engineer

Senior Azure Data Engineer: Digital Blue Solutions, LLC (Saratoga Springs, NY) seeks a Senior Azure Data Engineer to lead the development and maintenance of our advanced data solutions. Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory (ADF), Azure Databricks (ADB), and Azure Stream Analytics. Expertly manage data ingestion from multiple sources into Azure Blob Storage, Azure Data Lake, and Azure SQL Database, ensuring data integrity and availability. Implement real-time data streaming solutions using Azure Event Hub and Kafka, integrated with Azure Databricks for real-time analytics. Develop and optimize ETL processes for data warehousing, utilizing Azure Synapse Analytics, to support OLTP, OLAP, and BI reporting needs. Conduct data modeling, normalization, and denormalization to design efficient data structures for Operational Data Store (ODS) and Data Warehouse solutions. Lead data migration projects from on-premise infrastructure to Azure Cloud Services, ensuring seamless transitions and minimal downtime. Craft complex T-SQL scripts, including triggers, stored procedures, and functions, to support data processing and reporting requirements. Monitor and tune database and query performances, utilizing Azure Monitor and other tools to ensure optimal data processing speeds and system reliability. Collaborate closely with the DevOps team to implement CI/CD pipelines for data infrastructure projects using Azure DevOps and Git. Produce and maintain detailed documentation for data models, ETL processes, and data pipeline architectures to ensure clarity and sustainability. Design and implement artificial or augmented intelligence solutions to provide further insights into data. Travel required or telecommuting available to various unanticipated client locations throughout the U.S. Requirements: Masters degree in Business Analytics, Data Science/Engineering or a related field, along with 1 year of experience as a Data Engineer or Developer, including experience in: Azure Cloud Services; healthcare data management; Azure Data Factory, Azure Databricks, Azure SQL Database, and other Azure data services; data integration, data ingestion, and real-time data processing techniques; Python, PySpark, Spark SQL, and T-SQL scripting; data modeling, ETL development, and data warehousing principles; familiarity with CI/CD practices, Azure DevOps, and Git; and proven ability to work with cross-functional teams to translate business requirements into technical solutions. Salary offered $88,462 per year. Email resumes to Matt.Pontiusdigitalblue.io Minimum Salary: 88462 Maximum Salary: 88462 Salary Unit: Yearly