NavitsPartners
Snowflake Data Engineer - SDE24-17828
NavitsPartners, Boston, Massachusetts, us, 02298
Position Title:
Snowflake Data Engineer Duration:
6 Months (Tentative) Location:
Boston, MA (Hybrid) Position Overview:
Our client is seeking an experienced
Snowflake Data Engineer
to lead the implementation of the Division of Housing Stabilization data in a newly established Snowflake data warehouse. The role will involve designing, building, and maintaining critical components of the agency's data infrastructure. The Data Engineer will collaborate with various stakeholders, ensuring efficient and accurate data management, reporting, and analytics. The position will report directly to the Director of Information Technology Development. Key Responsibilities: Design, develop, and maintain a robust Snowflake data warehouse, focusing on data modeling, ETL processes, and ensuring high standards of data quality control. Ensure data integrity, security, and consistency across all data warehousing processes. Build and maintain data pipelines to integrate internal and external data sources efficiently. Develop scalable, reliable, and efficient data transformation pipelines, utilizing tools for data processing, testing, and deployment. Write Python scripts to automate data processing, transformation, and ingestion tasks, as well as for data quality control and reporting. Collaborate with data analysts and business stakeholders to understand requirements and deliver tailored data solutions. Design and develop data visualizations and reports using Snowflake's built-in tools or third-party platforms like Tableau. Enforce data validation rules, data cleansing processes, and access controls to maintain data quality and security. Optimize Snowflake performance, ensuring scalability and troubleshooting data-related issues as necessary. Develop and maintain comprehensive technical documentation, including data dictionaries, flow diagrams, and code comments. Conduct code reviews, ensuring adherence to coding standards and best practices. Work closely with the agency's data team and broader state technology teams to align on data strategy and technology standards. Effectively communicate technical data insights to non-technical stakeholders in a clear and concise manner. Provide mentorship and technical guidance to junior analysts and team members. Required Qualifications: 8+ years of experience in Snowflake data warehouse development and management, and data engineering. Extensive knowledge of Snowflake architecture, data modeling, and data warehousing concepts. Proficiency in SQL, including Snowflake's specific SQL dialect, with expertise in query optimization for performance enhancement. In-depth experience with Snowflake features such as cloning, time travel, data sharing, and micro-partitioning. Strong understanding of Snowflake's architecture, including virtual warehouses, storage, and compute separation. Expertise in Snowflake Role-Based Access Control (RBAC), data masking, and encryption techniques. Proven experience with data integration tools and ETL/ELT processes. Proficiency in Python or similar scripting languages for automation and data processing tasks. Knowledge of data security standards and compliance within Snowflake. Familiarity with cloud platforms such as AWS and Azure. SnowPro Advanced certification is highly desirable. Experience with data governance frameworks and tools. Strong experience in integrating Snowflake with third-party applications like Tableau, Salesforce, and APIs. Excellent analytical, problem-solving, and communication skills. Strong ability to work collaboratively within cross-functional teams. Superior verbal and written communication skills to interact effectively with project and business teams. Proven team-oriented attitude, with experience collaborating across different organizational levels. Desired Skills/Experience: SnowPro Advanced Architect or SnowPro Data Engineering certification preferred. Experience building complex data pipelines in a multi-cloud environment. Expertise in implementing data masking and aggregation techniques to mitigate privacy risks. Prior experience integrating data from Salesforce or similar solutions. Familiarity with CI/CD tools and practices. Experience with project management tools such as JIRA. Proficiency with GitHub for version control. Experience in affordable housing or public benefit program data integration is a plus. Familiarity with various software development methodologies, including Agile and Waterfall, and understanding their application for different development environments. Advanced skills in Microsoft Office tools (pivot tables, charts, Visio) and data analytics.
Snowflake Data Engineer Duration:
6 Months (Tentative) Location:
Boston, MA (Hybrid) Position Overview:
Our client is seeking an experienced
Snowflake Data Engineer
to lead the implementation of the Division of Housing Stabilization data in a newly established Snowflake data warehouse. The role will involve designing, building, and maintaining critical components of the agency's data infrastructure. The Data Engineer will collaborate with various stakeholders, ensuring efficient and accurate data management, reporting, and analytics. The position will report directly to the Director of Information Technology Development. Key Responsibilities: Design, develop, and maintain a robust Snowflake data warehouse, focusing on data modeling, ETL processes, and ensuring high standards of data quality control. Ensure data integrity, security, and consistency across all data warehousing processes. Build and maintain data pipelines to integrate internal and external data sources efficiently. Develop scalable, reliable, and efficient data transformation pipelines, utilizing tools for data processing, testing, and deployment. Write Python scripts to automate data processing, transformation, and ingestion tasks, as well as for data quality control and reporting. Collaborate with data analysts and business stakeholders to understand requirements and deliver tailored data solutions. Design and develop data visualizations and reports using Snowflake's built-in tools or third-party platforms like Tableau. Enforce data validation rules, data cleansing processes, and access controls to maintain data quality and security. Optimize Snowflake performance, ensuring scalability and troubleshooting data-related issues as necessary. Develop and maintain comprehensive technical documentation, including data dictionaries, flow diagrams, and code comments. Conduct code reviews, ensuring adherence to coding standards and best practices. Work closely with the agency's data team and broader state technology teams to align on data strategy and technology standards. Effectively communicate technical data insights to non-technical stakeholders in a clear and concise manner. Provide mentorship and technical guidance to junior analysts and team members. Required Qualifications: 8+ years of experience in Snowflake data warehouse development and management, and data engineering. Extensive knowledge of Snowflake architecture, data modeling, and data warehousing concepts. Proficiency in SQL, including Snowflake's specific SQL dialect, with expertise in query optimization for performance enhancement. In-depth experience with Snowflake features such as cloning, time travel, data sharing, and micro-partitioning. Strong understanding of Snowflake's architecture, including virtual warehouses, storage, and compute separation. Expertise in Snowflake Role-Based Access Control (RBAC), data masking, and encryption techniques. Proven experience with data integration tools and ETL/ELT processes. Proficiency in Python or similar scripting languages for automation and data processing tasks. Knowledge of data security standards and compliance within Snowflake. Familiarity with cloud platforms such as AWS and Azure. SnowPro Advanced certification is highly desirable. Experience with data governance frameworks and tools. Strong experience in integrating Snowflake with third-party applications like Tableau, Salesforce, and APIs. Excellent analytical, problem-solving, and communication skills. Strong ability to work collaboratively within cross-functional teams. Superior verbal and written communication skills to interact effectively with project and business teams. Proven team-oriented attitude, with experience collaborating across different organizational levels. Desired Skills/Experience: SnowPro Advanced Architect or SnowPro Data Engineering certification preferred. Experience building complex data pipelines in a multi-cloud environment. Expertise in implementing data masking and aggregation techniques to mitigate privacy risks. Prior experience integrating data from Salesforce or similar solutions. Familiarity with CI/CD tools and practices. Experience with project management tools such as JIRA. Proficiency with GitHub for version control. Experience in affordable housing or public benefit program data integration is a plus. Familiarity with various software development methodologies, including Agile and Waterfall, and understanding their application for different development environments. Advanced skills in Microsoft Office tools (pivot tables, charts, Visio) and data analytics.