Get new jobs for this search by email

Member of Technical Staff - Machine Learning Engineer, Inference (Pytorch)

Join to apply for the Member of Technical Staff - Machine Learning Engineer, Inference (Pytorch) role at Liquid AI

Continue with Google Continue with Google

Member of Technical Staff - Machine Learning Engineer, Inference (Pytorch)

3 weeks ago Be among the first 25 applicants

Join to apply for the Member of Technical Staff - Machine Learning Engineer, Inference (Pytorch) role at Liquid AI

Liquid AI, an MIT spin-off, is a foundation model company headquartered in Boston, Massachusetts. Our mission is to build capable and efficient general-purpose AI systems at every scale.

Our goal at Liquid is to build the most capable AI systems to solve problems at every scale, such that users can build, access, and control their AI solutions. This is to ensure that AI will get meaningfully, reliably and efficiently integrated at all enterprises. Long term, Liquid will create and deploy frontier-AI-powered solutions that are available to everyone.

We are hiring an ML Engineer (Inference) to build and optimize the end-to-end serving stack for Liquid AI’s foundation models. You will develop the pipeline between a trained model checkpoint and a production-grade, low-latency API. This is a highly technical role operating on the frontier of AI inference research and production

Desired Experience

• PyTorch
• Python
• Model-serving frameworks (e.g. TensorRT, vLLM, SGLang)
  
  
  
  

• You have experience building large-scale production stacks for model serving
• You have a solid understanding of ragged batching, dynamic load balancing, KV-cache management, and other multi-tenant serving techniques
• You have experience with applying quantization strategies (e.g., FP8, INT4) while safeguarding model accuracy
• You have deployed models in both single-GPU and multi-GPU environments and can diagnose performance issues across the stack
  
  
  
  

• Optimize and productionize the end-to-end pipeline for GPU model inference around Liquid Foundation Models (LFMs)
• Facilitate the development of next-generation Liquid Foundation Models from the lens of GPU inference
• Profile and robustify the stack for different batching and serving requirements
• Build and scale pipelines for test-time compute
  
  
  
  

• Hands-on experience with state-of-the-art technology at a leading AI company
• Deeper expertise in machine learning systems and efficient large model inference
• Opportunity to scale pipelines that directly influence user latency and experience with Liquid's models
• A collaborative, fast-paced environment where your work directly shapes our products and the next generation of LFMs
  
  

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Liquid AI by 2x

Get notified about new Member of Technical Staff jobs in Boston, MA.

Burlington, MA $70,000 - $115,000 3 hours ago

Senior Associate Director of Gift Planning

Senior Medical Lab Scientist, Microbiology -Dayshift

Senior Medical Lab Scientist, Hematology - Dayshift

Senior Medical Lab Scientist, Chemistry - Dayshift

Boston, MA
$145,000.00
-
$200,000.00
2 weeks ago

Member of Technical Staff - Machine Learning Engineer, Training Infrastructure

Member of Technical Staff - Applied Machine Learning Engineer

Member of Technical Staff - Machine Learning Research Engineer; Multi-Modal - Vision

Member of Technical Staff - Applied Machine Learning Lead

Member of Technical Staff - Applied Machine Learning Scientist

Member of Technical Staff - Machine Learning Engineer; VLM Data

Member of Technical Staff - Edge AI Inference Engineer

Boston, MA
$115,000.00
-
$230,000.00
1 day ago

System Administrator (Robotics / IoT / Networks)

Burlington, MA
$94,200.00
-
$223,500.00
6 days ago

Maintenance Technician - Pay up to $30/hr

Principal Member of Technical Staff - Java, Block Storage Control Plane

Burlington, MA
$96,800.00
-
$223,400.00
1 week ago

Boston, MA
$45,000.00
-
$83,000.00
4 days ago

Staff Engineer – Mobile (Android) (REMOTE)

Stabilization Specialist, Mary Eliza Mahoney Shelter

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.