Memorial Sloan Kettering Cancer Center
Cloud Data Infrastructure Engineer
Memorial Sloan Kettering Cancer Center, New York, New York, us, 10261
Cloud Data Infrastructure Engineer
Exciting Opportunity at MSKSeeking experienced data infrastructure engineer to help drive MSK’s data modernization journey. You will design, implement, and maintain data infrastructure solutions for a new hybrid and multi-cloud data ecosystem that will be used for multiple purposes including data science and analytics.Position Overview:
Collaborate with technical product management and operations to deliver the engineering roadmap following the agile model.Develop templates, playbooks, and automation to make infrastructure support and operations scalable.Build the cloud data platform using infrastructure as code (IAC).Develop CI/CD pipelines for both Terraform and data ingestion and transformation pipelines.Analyze and optimize data processes for efficiency, reliability, cost effectiveness, redundancy, and security.Help assess capabilities and integration feasibility of new technologies that are candidates for the ecosystem.Mentor team members on best practices for implementation, deployment, and operations for cloud data pipelines.Partner with Information Security teams to engineer secure data services on cloud platforms.Partner with enterprise cloud platform teams to engineer service implementations that comply with cloud governance standards.Key Qualifications:
Minimum 4+ years of Cloud Data Engineer working experience.Proficiency in translating designs into fully developed and well-structured Terraform code for managing Databricks and AWS resources.Proficiency with large scale data processing using PySpark including development and troubleshooting of PySpark pipelines.Proficiency with SQL and database design.Experience with GitOps and DataOps (preferably on GitHub).Solid understanding of cloud networking concepts, subnets, routing, load balancing, firewalls, and cloud security.Implementation expertise on AWS technologies including Cloud Formation, IAM, S3, EC2, Glue, MWAA.Experience in enterprise-scale environments, building highly available IaaS and PaaS solutions.Experience in shell scripting i.e., Bash.Experience in Cloud logging, monitoring, and observability tools such as AWS CloudWatch, Datadog.Core Skills:
An in-depth understanding of both business and technical discussions.Excellent communication and collaboration skills.Strong analytical, problem solving and organizational skills.Additional Information:
Location: 633 Third Avenue, NY.Reporting to Director, Data Management.Schedule: Hybrid, 4 days a month onsite.Pay Range: $118,800 - $196,200#J-18808-Ljbffr
Exciting Opportunity at MSKSeeking experienced data infrastructure engineer to help drive MSK’s data modernization journey. You will design, implement, and maintain data infrastructure solutions for a new hybrid and multi-cloud data ecosystem that will be used for multiple purposes including data science and analytics.Position Overview:
Collaborate with technical product management and operations to deliver the engineering roadmap following the agile model.Develop templates, playbooks, and automation to make infrastructure support and operations scalable.Build the cloud data platform using infrastructure as code (IAC).Develop CI/CD pipelines for both Terraform and data ingestion and transformation pipelines.Analyze and optimize data processes for efficiency, reliability, cost effectiveness, redundancy, and security.Help assess capabilities and integration feasibility of new technologies that are candidates for the ecosystem.Mentor team members on best practices for implementation, deployment, and operations for cloud data pipelines.Partner with Information Security teams to engineer secure data services on cloud platforms.Partner with enterprise cloud platform teams to engineer service implementations that comply with cloud governance standards.Key Qualifications:
Minimum 4+ years of Cloud Data Engineer working experience.Proficiency in translating designs into fully developed and well-structured Terraform code for managing Databricks and AWS resources.Proficiency with large scale data processing using PySpark including development and troubleshooting of PySpark pipelines.Proficiency with SQL and database design.Experience with GitOps and DataOps (preferably on GitHub).Solid understanding of cloud networking concepts, subnets, routing, load balancing, firewalls, and cloud security.Implementation expertise on AWS technologies including Cloud Formation, IAM, S3, EC2, Glue, MWAA.Experience in enterprise-scale environments, building highly available IaaS and PaaS solutions.Experience in shell scripting i.e., Bash.Experience in Cloud logging, monitoring, and observability tools such as AWS CloudWatch, Datadog.Core Skills:
An in-depth understanding of both business and technical discussions.Excellent communication and collaboration skills.Strong analytical, problem solving and organizational skills.Additional Information:
Location: 633 Third Avenue, NY.Reporting to Director, Data Management.Schedule: Hybrid, 4 days a month onsite.Pay Range: $118,800 - $196,200#J-18808-Ljbffr