Lead Software Engineer - Data Platform

SummaryPosted: Role Number:200562987The Data Platform team within the services organization is responsible for enabling analytics, experimentation, and ML feature engineering to support Siri, Search, iCloud, Apple Pay, and other beloved ML features on Apple devices. The mission of the Data Platform organization is to provide engineers and data scientists with an innovative, reliable, secure, and user-friendly infrastructure for ingesting, storing, processing, and interacting with data. This infrastructure ultimately supports teams in building successful data-intensive applications including machine learning, deep learning and high-performance computing. You will collaborate with numerous cross-functional teams to lead the planning, execution, and success of technical projects aimed at improving the Siri and Search experience for Apple customers. We are looking for a Staff Data Infrastructure Engineer passionate about advancing our data platform by building frameworks and architectures using state-of-the-art technology across the technical stack. You will collaborate with product and infrastructure teams to ensure operational efficiency is integral to every feature we launch. Are you passionate about developing an ML compute-enabled data platform and addressing large-scale data challenges? Join us and be part of the Data Platform journey.DescriptionYou will be responsible for defining and driving the infrastructure roadmap for our data platform, offering the best automation, tooling and data security control across our stack at Apple scale. You will collaborate with cross functional teams of innovative software engineers, product managers, and engineering managers to ensure that GPU infrastructure is reliable, scalable and optimized for performance. We embrace the use of open source technologies including Kubernetes, Spark, Flink, Trino, Iceberg for data processing and Ray, Feature Platform for ML compute usecases. RESPONSIBILITIES INCLUDE: Define and drive technical vision, roadmap, and strategy to manage GPU infrastructure of our platform for analytical and ML usecases. Participate in product design reviews to ensure performance optimization and monitoring is a core component of design Collaborate with stakeholders and cross-functional leaders in engineering, product, and operations across Apple to ensure the adoption of our data platform is done in a security compliant manner Liaison and coordinate with Corporate Information Security group for reviews, risk assessment, vulnerability treatment, security patches, etc Lead and mentor new hires or junior engineers Provide guidance and establish processes to ensure engineering excellence and operational sustainability with security compliance Foster a healthy, inclusive, collaborative, and technology-driven cultureMinimum Qualifications10+ years of software development experienceExperience with commercial and/or open source large scale data processing, storage frameworks and platformsStrong experience with infrastructure automation and provisioning including Kubernetes/Terraform.Experience architecting, building and operating large scale data processing systems in the public cloudProficient in best practices and enforcement for data security, automation-driven, proactive monitoringExcellent verbal and written communication skills, able to collaborate cross-functionally with program managers and engineering partnersExperience in influencing and driving key product innovations and opportunities across diverse collaboratorsBS, MS, or PhD degree in Computer Science or equivalent experiencePreferred QualificationsExperience working with or developing Large-language models (LLMs)Experience developing and optimizing algorithms that run efficiently on resource constrained platformsDesign, implementation and benchmarking/fine-tuning of ML/deep learning algorithmsFamiliarity with GPU computing or ML modeling frameworks.Experience with observability tools like Prometheus and Grafana.Pay & BenefitsAt Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,800 and $312,200, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.