CloudBC Labs
Sr Data Engineer (Snowflake)
CloudBC Labs, Iselin, New Jersey, us, 08830
Sr Data Engineer
Iselin, NJ
W2 Role
Job Responsibilities:
Able to provide architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data WarehouseProvide production support for Data Warehouse issues such data load problems, transformation translation problems.Able to translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.Able to work on data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations.Able to perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.Able to develop EL pipelines in and out of data warehouse using combination of Databricks, Python and Snow SQL.Able to provide data ingestion and processing pipelines using Python, Databricks, Snow SQLAble to Establish and monitor Operational Level Agreements for the health and performance/cost of the warehouse environment (Loads, queries, data quality)Required Qualifications
Overall 10+ years of experience is required.Minimum 3 years of experience in design and implementation of large-scale data solution on Azure Snowflake Data WarehouseHands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.Good experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modellingGood knowledge of MS Azure configuration items with respect to SnowflakeExperience in writing scripts (UNIX, Python)Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologiesGood to Have:
Experience in Finance / Banking industry - some understanding of Securities and Banking products.
Iselin, NJ
W2 Role
Job Responsibilities:
Able to provide architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data WarehouseProvide production support for Data Warehouse issues such data load problems, transformation translation problems.Able to translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.Able to work on data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations.Able to perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.Able to develop EL pipelines in and out of data warehouse using combination of Databricks, Python and Snow SQL.Able to provide data ingestion and processing pipelines using Python, Databricks, Snow SQLAble to Establish and monitor Operational Level Agreements for the health and performance/cost of the warehouse environment (Loads, queries, data quality)Required Qualifications
Overall 10+ years of experience is required.Minimum 3 years of experience in design and implementation of large-scale data solution on Azure Snowflake Data WarehouseHands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.Good experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modellingGood knowledge of MS Azure configuration items with respect to SnowflakeExperience in writing scripts (UNIX, Python)Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologiesGood to Have:
Experience in Finance / Banking industry - some understanding of Securities and Banking products.