Fiddler Labs, Inc
Staff Backend Software Engineer (Hybrid)
Fiddler Labs, Inc, Palo Alto, California, United States, 94306
Our Purpose
At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. With the rise of the internet, trust in AI has been degraded by a plethora of issues like spam, fraudulent transactions, hate speech, and online abuse. Fiddler enables organizations to get ahead of these issues by building trustworthy, transparent, and explainable AI solutions.
Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. Data Science, MLOps, and business teams use Fiddler AI to monitor, explain, analyze, and improve their AI solutions to identify performance gaps, mitigate bias, and drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the “why” and how behind model outcomes.
The Opportunity
In this role, you will be able to make a real impact on the safety of large language models and generative AI solutions across different verticals. You will work on the cutting edge of envisioning and building new types of tools and algorithms to monitor, explain, and improve such models.
What You'll Do
Design and build a world-class cloud platform to help enterprises monitor and analyze their ML models, covering both predictive models as well as LLM and Generative models.
Design enterprise-grade, scalable APIs and frameworks to run analysis and validation of customers’ ML models and workflows.
Develop new types of metrics and evaluation methods for quality and robustness of ML models.
Work with product and customer-facing teams to enhance and expand our product.
Recommend and implement engineering best practices, improve the functionality of existing software, and ensure that the design, application, and maintenance of software meets quality standards.
What We're Looking For Masters with no experience or Bachelor's with
7+ years .
Proficiency with Python.
Experience working with ML models in production. Experience with common LLM frameworks (Langchain, Llamaindex, RAG, HuggingFace, and eval frameworks like Ragas or Presidio).
Experience debugging and troubleshooting production systems, on-call support experience.
Experience working with common distributed systems infrastructure: Redis, Postgres, RabbitMQ, Celery, Flask.
Nice to have: Knowledge of infrastructure management (AWS / Google Cloud, Kubernetes, or equivalent on-premises technologies).
Nice to have: Experience building large scale distributed systems and working with columnar and vector databases.
Hybrid with at least 2 days a week in the Palo Alto office.
Pay Range in San Francisco California is $170,000 - $223,000. The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package, benefits, and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors. Fiddler is proud to be an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
#J-18808-Ljbffr
Design enterprise-grade, scalable APIs and frameworks to run analysis and validation of customers’ ML models and workflows.
Develop new types of metrics and evaluation methods for quality and robustness of ML models.
Work with product and customer-facing teams to enhance and expand our product.
Recommend and implement engineering best practices, improve the functionality of existing software, and ensure that the design, application, and maintenance of software meets quality standards.
What We're Looking For Masters with no experience or Bachelor's with
7+ years .
Proficiency with Python.
Experience working with ML models in production. Experience with common LLM frameworks (Langchain, Llamaindex, RAG, HuggingFace, and eval frameworks like Ragas or Presidio).
Experience debugging and troubleshooting production systems, on-call support experience.
Experience working with common distributed systems infrastructure: Redis, Postgres, RabbitMQ, Celery, Flask.
Nice to have: Knowledge of infrastructure management (AWS / Google Cloud, Kubernetes, or equivalent on-premises technologies).
Nice to have: Experience building large scale distributed systems and working with columnar and vector databases.
Hybrid with at least 2 days a week in the Palo Alto office.
Pay Range in San Francisco California is $170,000 - $223,000. The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package, benefits, and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors. Fiddler is proud to be an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
#J-18808-Ljbffr