CloudBC Labs
Sr Data Engineer (Snowflake)
CloudBC Labs, Iselin, New Jersey, 08830
Sr Data Engineer Iselin, NJ W2 Role Job Responsibilities: Able to provide architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse Provide production support for Data Warehouse issues such data load problems, transformation translation problems. Able to translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution. Able to work on data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations. Able to perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards. Able to develop EL pipelines in and out of data warehouse using combination of Databricks, Python and Snow SQL. Able to provide data ingestion and processing pipelines using Python, Databricks, Snow SQL Able to Establish and monitor Operational Level Agreements for the health and performance/cost of the warehouse environment (Loads, queries, data quality) Required Qualifications Overall 10 years of experience is required. Minimum 3 years of experience in design and implementation of large-scale data solution on Azure Snowflake Data Warehouse Hands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures. Good experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modelling Good knowledge of MS Azure configuration items with respect to Snowflake Experience in writing scripts (UNIX, Python) Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies Good to Have: Experience in Finance / Banking industry - some understanding of Securities and Banking products.