Senior Staff Software Engineer, Data Infrastructure - Slack

About SalesforceWe’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.Slack is looking for an expert Engineer to join us in Data Engineering. You will conceptualize, design, build and integrate scalable systems, platforms and tools that power the Data Warehouse. These systems help our partners implement, deploy and analyze data assets with a high level of autonomy and limited friction. You will play a meaningful role in scaling our data infrastructure as well as making our user experience interacting with data more efficient, cheerful and productive.As Slack’s data grows, the goal of the Data Infrastructure team is to provide the best blend of the tools and technologies that will strengthen the efficiency and dependability of the way we make decisions. Our Data Warehouse powers processing of our large and diverse datasets to allow our partners to focus on their strengths: data applications, data modeling, data analysis, search or machine learning.Data Infrastructure at SlackSlack's data infrastructure operates at tremendous scale with systems that process billions of records daily and millions of events per second. Our teams build and maintain the distributed systems including but not limited to Query and Compute engines, Scheduler, Authorization framework for data, Core infrastructure and Orchestration services for DW.This data infrastructure is 65PB+ of storage, processes ~900B records a day, 400+ ETL pipelines, 900+ Active DAGs, a growing community of 100+ developers, one of the largest Presto deployments in the industry.Slack's data warehouse powers product features like Enterprise Analytics and Search. We support the ML, Reporting & Analytics for Marketing, Sales and Finance aiding them in making data-informed decisions.Our infrastructure is built on EMR, Hadoop, Hive, Spark, Flink, Hudi, Apache Ranger, Sqoop, Airflow, Presto, Kafka, Secor and Aurora/ MySQL/ Vitess. Our services are developed using Python, Java and Golang and deployed on AWS.What you will be doing:Help envision, guide and implement the generation Data Warehouse at Slack solving for 10x scale.Comfortably communicate sophisticated issues to a diverse audience. Inspire and lead technical discussions that uncover new problems or novel solutions. These discussions further help drive decision making within your organization.Collaborate with peers in Engineering to identify and surface fundamental issues in the system, providing strategy and direction for major functional areas.Advise engineers to triage bugs, troubleshoot sophisticated production issues and provide a fix across the stack related to our services.Be a role model and a multiplier, coaching and mentoring engineers.Define and articulate the guiding principles for strategic development of methods, techniques, and evaluation criteria for projects and programs.Own the software lifecycle all the way from conceptualizing high level and complex requirements to design, build and ship with informative and forward-looking approaches.Provide visibility into the health of our systems and infrastructure with a comprehensive view of data flow, resources usage, data lineage, etc.Evolve maturity of our monitoring systems and processes to improve visibility and failures detection in our infrastructure.Write, review, or provide feedback on technical design proposals.What you should have:10+ years of relevant technical experience, including significant experience with Data Warehouse technologies building pipelines, working with ingestion frameworks and building & maintaining large scale data warehouse systems.You have operated large distributed systems at low cost while at the same time worked on solving Scalability, Performance, Reliability challenges.You have a strong dedication to code quality, automation and operational excellence: unit/integration tests, scripts, workflows.You are a strong communicator. Explaining sophisticated technical concepts to designers, support, and other engineers is no problem for you.In-depth knowledge of not only the engineering functions but in general data technologies that power analytics but also the business strategies and company goals.Good knowledge of the production technologies we use including AWS (CloudFormation, EC2), Docker, Terraform, Kubernetes, Chef.A Bachelor's degree in Computer Science, Engineering or a related field, or equivalent training, fellowship, or work experience.Slack has a positive, diverse, and supportive culture—we look for people who are curious, inventive, and work to be a little better every single day. In our work together we seek to be smart, humble, hardworking and, above all, collaborative.

#J-18808-Ljbffr