IBM
Principal Software Engineer, Gluten engine
IBM, Portland, Oregon, United States, 97204
Introduction
A career in IBM Software means you'll be part of a team that transforms our customers challenges into solutions. Seeking new possibilities and always staying curious, we are a team dedicated to creating the world's leading AI-powered, cloud-native software solutions for our customers. Our renowned legacy creates endless global opportunities for our IBMers, so the door is always open for those who want to grow their career.
We are seeking a skilled back-end developer to join our IBM Software team. As part of our team, you will be responsible for developing and maintaining high-quality software products, working with a variety of technologies and programming languages.
Your Role and Responsibilities
We are seeking a highly skilled and experienced Principal Software Engineer to join our team and lead the development of the Gluten engine. The ideal candidate will have a strong background in distributed systems, native code optimization, and a deep understanding of SQL engines. This role involves architecting and implementing solutions that enhance the performance and scalability of the Gluten project, which integrates native libraries with Apache Spark SQL.
Key Responsibilities:
Lead the design, development, and optimization of the Gluten engine, ensuring high performance and scalability.
Collaborate with cross-functional teams to integrate and test new features and backends.
Ensure robust fallback mechanisms to handle unsupported operators within the Gluten framework.
Collect and analyze performance metrics, identifying and resolving bottlenecks.
Mentor and guide junior engineers, fostering a culture of technical excellence and continuous improvement.
Contribute to the open-source community, representing the organization in forums, discussions, and conferences.
Required Technical and Professional Expertise
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
10+ years of experience in software engineering, with a focus on distributed systems and SQL engines.
Strong proficiency in C++ and Java, with a deep understanding of JNI and native code optimization.
Experience with Apache Spark, Substrait, Velox, ClickHouse, and Apache Arrow.
Proven track record of designing and implementing high-performance, scalable systems.
Excellent problem-solving skills and the ability to troubleshoot complex issues.
Strong communication and leadership skills, with experience mentoring and guiding engineering teams.
Familiarity with open-source development practices and community engagement.
Preferred Technical and Professional Expertise
Experience contributing to open-source projects, particularly within the Apache ecosystem.
Knowledge of modern hardware architectures and optimization techniques (e.g., SIMD, vectorization).
Familiarity with containerization technologies like Docker and orchestration frameworks like Kubernetes.
About Business Unit
IBM Software infuses core business operations with intelligence—from machine learning to generative AI—to help make organizations more responsive, productive, and resilient. IBM Software helps clients put AI into action now to create real value with trust, speed, and confidence across digital labor, IT automation, application modernization, security, and sustainability.
Your Life @ IBM
In a world where technology never stands still, we understand that dedication to our clients' success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.
Are you ready to be an IBMer?
Location Statement
IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to:
Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well-being.
Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, and 12 weeks parental bonding leave in accordance with IBM Policy.
Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals.
Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences.
This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role.
IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship.
Being You @ IBM
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics.
#J-18808-Ljbffr
A career in IBM Software means you'll be part of a team that transforms our customers challenges into solutions. Seeking new possibilities and always staying curious, we are a team dedicated to creating the world's leading AI-powered, cloud-native software solutions for our customers. Our renowned legacy creates endless global opportunities for our IBMers, so the door is always open for those who want to grow their career.
We are seeking a skilled back-end developer to join our IBM Software team. As part of our team, you will be responsible for developing and maintaining high-quality software products, working with a variety of technologies and programming languages.
Your Role and Responsibilities
We are seeking a highly skilled and experienced Principal Software Engineer to join our team and lead the development of the Gluten engine. The ideal candidate will have a strong background in distributed systems, native code optimization, and a deep understanding of SQL engines. This role involves architecting and implementing solutions that enhance the performance and scalability of the Gluten project, which integrates native libraries with Apache Spark SQL.
Key Responsibilities:
Lead the design, development, and optimization of the Gluten engine, ensuring high performance and scalability.
Collaborate with cross-functional teams to integrate and test new features and backends.
Ensure robust fallback mechanisms to handle unsupported operators within the Gluten framework.
Collect and analyze performance metrics, identifying and resolving bottlenecks.
Mentor and guide junior engineers, fostering a culture of technical excellence and continuous improvement.
Contribute to the open-source community, representing the organization in forums, discussions, and conferences.
Required Technical and Professional Expertise
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
10+ years of experience in software engineering, with a focus on distributed systems and SQL engines.
Strong proficiency in C++ and Java, with a deep understanding of JNI and native code optimization.
Experience with Apache Spark, Substrait, Velox, ClickHouse, and Apache Arrow.
Proven track record of designing and implementing high-performance, scalable systems.
Excellent problem-solving skills and the ability to troubleshoot complex issues.
Strong communication and leadership skills, with experience mentoring and guiding engineering teams.
Familiarity with open-source development practices and community engagement.
Preferred Technical and Professional Expertise
Experience contributing to open-source projects, particularly within the Apache ecosystem.
Knowledge of modern hardware architectures and optimization techniques (e.g., SIMD, vectorization).
Familiarity with containerization technologies like Docker and orchestration frameworks like Kubernetes.
About Business Unit
IBM Software infuses core business operations with intelligence—from machine learning to generative AI—to help make organizations more responsive, productive, and resilient. IBM Software helps clients put AI into action now to create real value with trust, speed, and confidence across digital labor, IT automation, application modernization, security, and sustainability.
Your Life @ IBM
In a world where technology never stands still, we understand that dedication to our clients' success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.
Are you ready to be an IBMer?
Location Statement
IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to:
Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well-being.
Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, and 12 weeks parental bonding leave in accordance with IBM Policy.
Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals.
Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences.
This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role.
IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship.
Being You @ IBM
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics.
#J-18808-Ljbffr