Research Engineer, Model Inference

The OpportunityIf you are a Research Engineer with expertise in model optimization and integration into production environments, and a passion for applying state-of-the-art AI innovations to make conversations more valuable, look no further!As a Research Engineer on our Platform team, you'll advance the frontier of AI by maximizing efficiency and performance to achieve feats previously thought impossible. You’ll do so by optimizing and deploying machine learning models for real-time applications. Join us alongside a cohort of industry-leading scientists, ML engineers, and production engineers as we grow Otter’s AI-powered collaboration platform that’s transcribed over 1B meetings. Together, we strive to elevate the value of conversations through innovative solutions.Your ImpactModel optimization: Collaborate with machine learning researchers to understand model architectures and algorithms.Implement optimization techniques to enhance machine learning models' efficiency and inference speed on productionDeployment and Integration: Work closely with product engineers to integrate machine learning models into production systems in a scalable wayOptimize models for real-time inference, ensuring low latency and high-throughput Set up monitoring systems to track model performance in real time.Ensure models can scale horizontally to handle the increased load.Implement strategies for resource-efficient inference, considering factors such as memory usage and CPU/GPU utilization.Collaborate with cross-functional teams to understand requirements and constraints.Provide technical expertise on inference-related matters during the model development lifecycle.Document the deployment and optimization processes for machine learning models.We're looking for someone whoMasters degree + 3 years of industry experience or Ph.D. degree in computer science, machine learning, speech/language processing or related fieldExperience in PyTorchProficiency in PythonExperience in C++Basic knowledge of CUDAStrong understanding of machine learning models, algorithms, and deployment strategiesExperience with model optimization techniques and performance profilingFamiliarity with docker and KubernetesKnowledge of  AWSExperience with monitoring tools About Otter.ai We are in the business of shaping the future of work. Our mission is to make conversations more valuable.With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are dedicated to inclusivity.*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.Salary rangeSalary Range: $175,000 to $220,000 USD per year.This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.