Synergy Staffing is hiring: Data Engineer in Philadelphia
Synergy Staffing, Philadelphia, PA, US
Job Description
We are seeking a talented and experienced Data Engineer to join our team and help stand up a robust Snowflake environment in Azure for a high-priority project in the energy grid sector. This position requires expertise in data engineering, cloud infrastructure, and data pipelines, with a specific focus on leveraging Azure Data Factory (ADF) to integrate and transform data for our client's needs. If you have a passion for optimizing data workflows and building scalable cloud-based data architectures, we want to hear from you!
Key Responsibilities:
- Snowflake Environment Setup: Design, configure, and deploy Snowflake instances within the Azure cloud environment to meet the specific requirements of the energy grid client.
- Data Integration & ETL: Build end-to-end data pipelines using Azure Data Factory (ADF) to ingest, transform, and load (ETL) data from multiple sources into the Snowflake data warehouse.
- Data Modeling & Optimization: Develop and implement best practices for data modeling, ensuring efficient, high-performance queries and scalable data architecture in Snowflake.
- Cloud Infrastructure Management: Work with Azure tools (e.g., Azure Storage, Azure Synapse Analytics) to manage data storage, processing, and orchestration needs.
- Automation & Monitoring: Implement automation for data pipeline orchestration, error handling, and monitoring to ensure reliable, consistent data delivery and performance.
- Collaboration & Stakeholder Engagement: Work closely with data architects, data analysts, business intelligence teams, and other stakeholders to understand data requirements and ensure alignment with business goals.
- Security & Compliance: Ensure the design and implementation of Snowflake and Azure-based solutions adhere to industry-standard security protocols and compliance requirements.
- Documentation & Knowledge Transfer: Document architecture, ETL processes, and other key components for ongoing maintenance and future enhancements.
Required Skills and Qualifications:
- Proven experience as a Data Engineer, with a strong focus on cloud data solutions, particularly Snowflake and Azure.
- Hands-on expertise with Azure Data Factory (ADF) for building data integration pipelines, transformations, and data orchestration.
- Experience with Snowflake architecture, including data warehousing, database design, optimization, and performance tuning.
- Strong understanding of SQL, data transformation, and ETL processes.
- Familiarity with other Azure services, such as Azure Data Lake, Azure Synapse Analytics, and Azure Blob Storage.
- Knowledge of best practices for building scalable, cost-effective, and high-performance cloud data solutions.
- Experience working with large datasets in industries such as energy, utilities, or infrastructure is a plus.
- Strong communication and collaboration skills to work with cross-functional teams and stakeholders.
- Experience with CI/CD pipelines, version control systems, and automation tools is a plus.
- Familiarity with data governance, data security, and compliance regulations (e.g., GDPR, HIPAA, etc.) is preferred.
Preferred Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Certification in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate) or Snowflake is a plus.
- Experience with energy grid data, IoT, or smart grid systems is a strong advantage.
- Knowledge of Python, Spark, or other data processing frameworks is desirable.
- Familiarity with data visualization tools (e.g., Power BI, Tableau) and reporting systems.