Full Stack Engineer, LLM APIs (Staff/Senior)

Job Description

Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.

Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.

We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense.

The Role

We are seeking Staff and Senior Full Stack Engineers to join our growing team! You’ll help us build internal UI products to support LLM Model orchestration, evaluation, and dataset curation. You will work closely with our Applied AI and product teams to build innovative ML powered solutions to push the state of the art in Healthcare AI technology.

What You'll Do

• Design, build, and maintain highly scalable, cloud-based services using TypeScript, Python, and React.
• Create tooling to support the ML model lifecycle including model evaluations, dataset curation, and training infrastructure.
• Build scalable infrastructure for LLM model orchestration powered by an intuitive and easy to use user experience.
• Make architecture and technology decisions that align with business needs, balancing innovation with security and reliability.
• Enhance our platform’s performance and scalability, with a focus on creating seamless user experiences.
• Work cross-functionally with teams like product, machine learning, and design to ensure the success of new features from conception to deployment.
• Research and evaluate commercial and open-source tools to implement the most effective and scalable solutions.
• Advocate for best coding practices, mentor junior engineers, and ensure the growth of technical excellence across the team.
• Build deep empathy for users, maintaining a user-centric mindset when implementing solutions.
• Contribute to the development and expansion of our ML infrastructure, ensuring smooth interaction between the product and ML models.

What You'll Bring

• 5+ years of experience building and scaling distributed systems using modern technologies like TypeScript, Python, React, and Node.js.
• Hands-on experience integrating and working with Large Models (LLMs) and APIs, with familiarity in fine-tuning and prompt engineering.
• Proficiency in working with cloud services (AWS, GCP), infrastructure as code (Terraform), and containerization (Docker, Kubernetes).
• Proven experience leading engineering teams or owning major software components from development to production.
• A background in optimizing and scaling inference systems for LLMs or similar AI-based systems is highly desirable.
• Experience working in regulated environments (HIPAA, SOC 2, or HITRUST) is a plus.
• A passion for learning new technologies and sharing knowledge within your team.

Base Salary: $185,000 USD - $265,000+ USD per year + Equity

The salary range provided is based on transparent pay guidelines and is an estimate for candidates residing in the San Francisco and New York City metro areas. The actual base salary will vary depending on the candidate's location, relevant experience, skills, qualifications, and other job-related factors. Additionally, this role may include the opportunity to participate in a company stock option plan as part of the total compensation package.

Must be willing to work from our SF office at least 3x per week (Relocation assistance is available for candidates willing to move to San Francisco).

This position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of (3) three times per week.

Must be willing to travel up to 10%.

Abridge typically hosts a three-day builder team retreat every 3-6 months. These retreats often feature internal hackathons, collaborative project sessions, and social events that allow the team to connect in person.

Why Work at Abridge?

• Be a part of a trailblazing, mission-driven organization that is powering deeper understanding in healthcare through AI!
• Opportunity to work and grow with talented individuals and have ownership and impact at a high-growth startup.
• Flexible/Unlimited PTO — Salaried team members can take off as much approved time off as they need, plus 13 paid holidays.
• Equity — For all salaried team members.
• Medical insurance — We pay 100% of the premium for you + 75% for dependents. 3 Aetna plans to choose from.
• Dental & Vision insurance — We pay 100% of the premium for you + 75% for dependents. 2 Aetna plans to choose from.
• Flexible Spending (FSA) & Health Savings (HSA) Accounts.
• Learning and Development budget — $3,000 per year for coaching, courses, workshops, conferences, etc.
• 401k Plan — Contribute pre-tax dollars toward retirement savings.
• Paid Parental Leave — 16 weeks paid parental leave, for all full-time employees.
• Flexible working hours — We care more about what you accomplish than what specific hours you’re working.
• Home Office Budget — We provide up to $1,600 in a one-time reimbursement to set up your home office.
• Sabbatical Leave — 30 days of paid Sabbatical Leave after 5 years of employment.
• ...Plus much more!

Life at Abridge

At Abridge, we’re driven by our mission to bring understanding and follow-through to every medical conversation. Our culture is founded on doing things the “inverse” way in a legacy system—focusing on patients, instead of the system; focusing on outcomes, instead of billing; and focusing on the end-user experience, instead of a hospital administrator's mandate.

Abridgers are engineers, scientists, designers, and health policy experts from a diverse set of backgrounds—an experiment in alchemy that helps us transform an industry dominated by EHRs and enterprise into a consumer-driven experience, one recording at a time. We believe in strong ideas, loosely held, and place a high premium on a growth mindset. We push each other to grow and expose each other to the latest in our respective fields.

Abridge is an equal opportunity employer and is at the core of what we do. We actively welcome applicants from all backgrounds.

Staying Safe - Protect Yourself From Recruitment Fraud

We are aware of individuals and entities fraudulently representing themselves as Abridge recruiters and/or hiring managers. Abridge will never ask for financial information or payment, or for personal information such as bank account number or social security number during the job application or interview process. Any emails from the Abridge recruiting team will come from an @abridge.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this article. Please exercise caution and cease communications if something feels suspicious about your interactions.

Compensation Range: $185K - $265K

#J-18808-Ljbffr