HPE
AI/HPC Infrastructure Software Engineer
HPE, Spring, Texas, us, 77391
AI/HPC Infrastructure Software Engineer
This role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.
Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today’s complex world. Our culture thrives on finding new and better ways to accelerate what’s next. We know diverse backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE. Job Description: Artificial Intelligence (Generative AI and all of Machine and Deep Learning) and High-Performance Computing are the fastest growing workloads in the industry today.
These workloads are pushing the leading edge of networking technology forward at a rapid pace.
Come join the Slingshot Ethernet Fabric team, part of HPE's HPC and AI organization, and make an impact on the high-performance fabric business. We are looking for an Infrastructure Software Engineer to help expand HPE's High Performance Ethernet Fabric product growth through the development of the network infrastructure capabilities necessary for AI/ML and HPC workloads and applications.
This includes directly working with the open-source communities to optimize and support the latest system solutions including Kubernetes workload and orchestration for Slingshot based clusters, resource management solutions (e.g. Slurm or PBS Pro), and other system capabilities necessary to deploy, manage, and maintain a scale AI cluster, system, and workload. Join the HPE AI Fabric team and be a part of the growth and evolution of Artificial Intelligence (AI), high speed networking fabrics, and the fastest growing and most significant technology revolution since the Internet. Responsibilities include, but are not limited to: Engage and work with the GPU/CPU vendors, customers, AI ISV and open-source SW communities to validate, tune, and enable high performance AI applications on the Slingshot Ethernet fabric. Work on partner engagements for the leading communication libraries, middleware and frameworks used in AI development today (NCCL, RCCL, UCX, OneCCL. Pytorch, etc.). Design, implement and maintain system software that enables communication between GPUS, CPUs, and storage in scale out AI and HPC systems.
Work with all the leading architectures and vendors in the AI and Data Center markets – Nvidia, AMD, Intel. Work with the OEM, ODM, and VAR channels vendors on bring Slingshot to a broader set of customers. Validate and tune applications driving those engagements. Develop and own HPE product usage support, upstreaming and community engagements, and internal testing and infrastructure. Work with cross-disciplinary teams to understand business requirements and align software direction to meet those needs. Qualifications should Include: Bachelor’s/master's degree in computer science, engineering, or related field 5+ years of relevant experience with a background in networking and communications software development and/or architecture in the Data Center, university, government lab, or AI-centric environments. Experience in scripting programming using languages such as Python, Go, and bash scripting. Experience with HPC(High-Performance Computing), concepts, and the applications that drive this field. Experience with
large cluster deployment and management Familiarity with low-latency/high-bandwidth, interconnected infrastructure (including InfiniBand, Ethernet, RDMA/RoCE, and others). Knowledge of HPC storage (FC, SAS) principles, file systems (NFS, Lustre, ZFS, etc.), and compute node storage, Network Attached Storage. Experience
in setting up and managing monitoring solutions (Elasticsearch, Logstash, Prometheus, Grafana, Kibana, etc.) In-depth understating of container technologies like Docker, Containerd, Singularity, Podman Good Understanding of Kubernetes environments (deployments, storage, services, jobs, ingress, egress, etc) Experience with Kubernetes extensions (device-plugins, CRD, CNIs, and CSIs) Good Understanding of Kubernetes design patterns (operators, helm charts, kustomize, etc) Experience deploying and managing HPC workloads (Slurms, PBS, etc), including system architecture, job scheduling, and queue management. Experience with Network Automation (Ansible, Terraform, etc. ) Expertise with administration, monitoring, and maintaining secure Linux/Unix operating systems (SLES, RHEL, Ubuntu). Excellent communication, interpersonal, and customer collaboration skills “Nice-to-have” Qualifications: Familiarity with HPC distributed computing Familiarity with Open Fabric Interface (libfabric) Familiarity with MPI (CrayMPI, OMPI, IntelMPI) Familiarity with Collective Communications Libraries (NCCL, RCCL, etc) Data Center planning - rack elevations, cabling plan, cables/transceivers. Familiarity with various CI/CD systems (Jenkins, GitHub Actions, etc). Network services such as DDI, Firewalls, and Load Balancers IP planning Additional Skills: Artificial Intelligence Technologies, Cross Domain Knowledge, Data Engineering, Data Science, Design Thinking, Development Fundamentals, Full Stack Development, IT Performance, Machine Learning Operations, Scalability Testing, Security-First Mindset #unitedstates Additional Skills: Cloud Architectures, Cross Domain Knowledge, Design Thinking, Development Fundamentals, DevOps, Distributed Computing, Microservices Fluency, Full Stack Development, Security-First Mindset, Solutions Design, Testing & Automation, User Experience (UX)
What We Can Offer You: Health & Wellbeing We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing. Personal & Professional Development We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division. Diversity, Inclusion & Belonging We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know diverse backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. Let's Stay Connected: Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE. #unitedstates #highperformancecompute
Job: Engineering
Job Level: TCP_04
States with Pay Range Requirement The expected salary/wage range for a U.S.-based hire filling this position is provided below. Actual offer may vary from this range based upon geographic location, work experience, education/training, and/or skill level. If this is a sales role, then the listed salary range reflects combined base salary and target-level sales compensation pay. If this is a non-sales role, then the listed salary range reflects base salary only. Variable incentives may also be offered. Information about employee benefits offered can be found at https://myhperewards.com/main/new-hire-enrollment.html. USD Annual Salary: $117,500.00 - $270,000.00 Estimated job application period closure is January 2025. While this is the expected application time frame, there are many factors which may result in a change. If this position is still open beyond the anticipated closure time frame, it is likely HPE is still actively recruiting for this role and all qualified and interested candidates are encouraged to apply.
HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT and Affirmative Action employer. We are committed to diversity and building a team that represents a variety of backgrounds, perspectives, and skills. We do not discriminate and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global diverse team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity. Hewlett Packard Enterprise is EEO F/M/Protected Veteran/ Individual with Disabilities. HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories. .
Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today’s complex world. Our culture thrives on finding new and better ways to accelerate what’s next. We know diverse backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE. Job Description: Artificial Intelligence (Generative AI and all of Machine and Deep Learning) and High-Performance Computing are the fastest growing workloads in the industry today.
These workloads are pushing the leading edge of networking technology forward at a rapid pace.
Come join the Slingshot Ethernet Fabric team, part of HPE's HPC and AI organization, and make an impact on the high-performance fabric business. We are looking for an Infrastructure Software Engineer to help expand HPE's High Performance Ethernet Fabric product growth through the development of the network infrastructure capabilities necessary for AI/ML and HPC workloads and applications.
This includes directly working with the open-source communities to optimize and support the latest system solutions including Kubernetes workload and orchestration for Slingshot based clusters, resource management solutions (e.g. Slurm or PBS Pro), and other system capabilities necessary to deploy, manage, and maintain a scale AI cluster, system, and workload. Join the HPE AI Fabric team and be a part of the growth and evolution of Artificial Intelligence (AI), high speed networking fabrics, and the fastest growing and most significant technology revolution since the Internet. Responsibilities include, but are not limited to: Engage and work with the GPU/CPU vendors, customers, AI ISV and open-source SW communities to validate, tune, and enable high performance AI applications on the Slingshot Ethernet fabric. Work on partner engagements for the leading communication libraries, middleware and frameworks used in AI development today (NCCL, RCCL, UCX, OneCCL. Pytorch, etc.). Design, implement and maintain system software that enables communication between GPUS, CPUs, and storage in scale out AI and HPC systems.
Work with all the leading architectures and vendors in the AI and Data Center markets – Nvidia, AMD, Intel. Work with the OEM, ODM, and VAR channels vendors on bring Slingshot to a broader set of customers. Validate and tune applications driving those engagements. Develop and own HPE product usage support, upstreaming and community engagements, and internal testing and infrastructure. Work with cross-disciplinary teams to understand business requirements and align software direction to meet those needs. Qualifications should Include: Bachelor’s/master's degree in computer science, engineering, or related field 5+ years of relevant experience with a background in networking and communications software development and/or architecture in the Data Center, university, government lab, or AI-centric environments. Experience in scripting programming using languages such as Python, Go, and bash scripting. Experience with HPC(High-Performance Computing), concepts, and the applications that drive this field. Experience with
large cluster deployment and management Familiarity with low-latency/high-bandwidth, interconnected infrastructure (including InfiniBand, Ethernet, RDMA/RoCE, and others). Knowledge of HPC storage (FC, SAS) principles, file systems (NFS, Lustre, ZFS, etc.), and compute node storage, Network Attached Storage. Experience
in setting up and managing monitoring solutions (Elasticsearch, Logstash, Prometheus, Grafana, Kibana, etc.) In-depth understating of container technologies like Docker, Containerd, Singularity, Podman Good Understanding of Kubernetes environments (deployments, storage, services, jobs, ingress, egress, etc) Experience with Kubernetes extensions (device-plugins, CRD, CNIs, and CSIs) Good Understanding of Kubernetes design patterns (operators, helm charts, kustomize, etc) Experience deploying and managing HPC workloads (Slurms, PBS, etc), including system architecture, job scheduling, and queue management. Experience with Network Automation (Ansible, Terraform, etc. ) Expertise with administration, monitoring, and maintaining secure Linux/Unix operating systems (SLES, RHEL, Ubuntu). Excellent communication, interpersonal, and customer collaboration skills “Nice-to-have” Qualifications: Familiarity with HPC distributed computing Familiarity with Open Fabric Interface (libfabric) Familiarity with MPI (CrayMPI, OMPI, IntelMPI) Familiarity with Collective Communications Libraries (NCCL, RCCL, etc) Data Center planning - rack elevations, cabling plan, cables/transceivers. Familiarity with various CI/CD systems (Jenkins, GitHub Actions, etc). Network services such as DDI, Firewalls, and Load Balancers IP planning Additional Skills: Artificial Intelligence Technologies, Cross Domain Knowledge, Data Engineering, Data Science, Design Thinking, Development Fundamentals, Full Stack Development, IT Performance, Machine Learning Operations, Scalability Testing, Security-First Mindset #unitedstates Additional Skills: Cloud Architectures, Cross Domain Knowledge, Design Thinking, Development Fundamentals, DevOps, Distributed Computing, Microservices Fluency, Full Stack Development, Security-First Mindset, Solutions Design, Testing & Automation, User Experience (UX)
What We Can Offer You: Health & Wellbeing We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing. Personal & Professional Development We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division. Diversity, Inclusion & Belonging We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know diverse backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. Let's Stay Connected: Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE. #unitedstates #highperformancecompute
Job: Engineering
Job Level: TCP_04
States with Pay Range Requirement The expected salary/wage range for a U.S.-based hire filling this position is provided below. Actual offer may vary from this range based upon geographic location, work experience, education/training, and/or skill level. If this is a sales role, then the listed salary range reflects combined base salary and target-level sales compensation pay. If this is a non-sales role, then the listed salary range reflects base salary only. Variable incentives may also be offered. Information about employee benefits offered can be found at https://myhperewards.com/main/new-hire-enrollment.html. USD Annual Salary: $117,500.00 - $270,000.00 Estimated job application period closure is January 2025. While this is the expected application time frame, there are many factors which may result in a change. If this position is still open beyond the anticipated closure time frame, it is likely HPE is still actively recruiting for this role and all qualified and interested candidates are encouraged to apply.
HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT and Affirmative Action employer. We are committed to diversity and building a team that represents a variety of backgrounds, perspectives, and skills. We do not discriminate and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global diverse team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity. Hewlett Packard Enterprise is EEO F/M/Protected Veteran/ Individual with Disabilities. HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories. .