Data Engineer Job at Synergy Staffing in Philadelphia

We are seeking a talented and experienced Data Engineer to join our team and help stand up a robust Snowflake environment in Azure for a high-priority project in the energy grid sector. This position requires expertise in data engineering, cloud infrastructure, and data pipelines, with a specific focus on leveraging Azure Data Factory (ADF) to integrate and transform data for our client's needs. If you have a passion for optimizing data workflows and building scalable cloud-based data architectures, we want to hear from you!

Key Responsibilities:

- Snowflake Environment Setup: Design, configure, and deploy Snowflake instances within the Azure cloud environment to meet the specific requirements of the energy grid client.

- Data Integration & ETL: Build end-to-end data pipelines using Azure Data Factory (ADF) to ingest, transform, and load (ETL) data from multiple sources into the Snowflake data warehouse.

- Data Modeling & Optimization: Develop and implement best practices for data modeling, ensuring efficient, high-performance queries and scalable data architecture in Snowflake.

- Cloud Infrastructure Management: Work with Azure tools (e.g., Azure Storage, Azure Synapse Analytics) to manage data storage, processing, and orchestration needs.

- Automation & Monitoring: Implement automation for data pipeline orchestration, error handling, and monitoring to ensure reliable, consistent data delivery and performance.

- Collaboration & Stakeholder Engagement: Work closely with data architects, data analysts, business intelligence teams, and other stakeholders to understand data requirements and ensure alignment with business goals.

- Security & Compliance: Ensure the design and implementation of Snowflake and Azure-based solutions adhere to industry-standard security protocols and compliance requirements.

- Documentation & Knowledge Transfer: Document architecture, ETL processes, and other key components for ongoing maintenance and future enhancements.

Required Skills and Qualifications:

- Proven experience as a Data Engineer, with a strong focus on cloud data solutions, particularly Snowflake and Azure.

- Hands-on expertise with Azure Data Factory (ADF) for building data integration pipelines, transformations, and data orchestration.

- Experience with Snowflake architecture, including data warehousing, database design, optimization, and performance tuning.

- Strong understanding of SQL, data transformation, and ETL processes.

- Familiarity with other Azure services, such as Azure Data Lake, Azure Synapse Analytics, and Azure Blob Storage.

- Knowledge of best practices for building scalable, cost-effective, and high-performance cloud data solutions.

- Experience working with large datasets in industries such as energy, utilities, or infrastructure is a plus.

- Strong communication and collaboration skills to work with cross-functional teams and stakeholders.

- Experience with CI/CD pipelines, version control systems, and automation tools is a plus.

- Familiarity with data governance, data security, and compliance regulations (e.g., GDPR, HIPAA, etc.) is preferred.

Preferred Qualifications:

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Certification in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate) or Snowflake is a plus.

- Experience with energy grid data, IoT, or smart grid systems is a strong advantage.

- Knowledge of Python, Spark, or other data processing frameworks is desirable.

- Familiarity with data visualization tools (e.g., Power BI, Tableau) and reporting systems.