Logo
Valid8 Financial, Inc.

Backend Engineer

Valid8 Financial, Inc., Palo Alto, California, United States, 94306


Modern enterprise copilots & agents call for last-mile quality, enterprise-grade robustness and scalable operation costs, beyond simplified programming interfaces for generative AI. Nexusflow tackles this challenge, enabling enterprises to own their workflow copilots & agents stacked on top of powerful yet cost-effective, compact LLMs. Our team has built the open-source LLM, NexusRaven-V2, rivaling GPT-4 in function calling with a 100X smaller model size. Our team members are also behind the scenes of Starling, the #1 ranked compact 7B chat model based on human evaluation in Chatbot Arena.Nexusflow is currently adding Backend Engineers to our team. Our Backend Engineers package up our technology in models and last-mile quality tooling. They will be the driving force to build our products and solutions, in extensive collaboration with our ML Engineers and Front-end Engineers.Responsibilities

API system development for copilot & agent quality tooling.API system development for copilot serving and integration with a focus on enterprise-grade requirements in the following areas:Integration with on-prem & cloud compute vendors.Integration with software tools required in customer-oriented solutions.Distributed system and optionally GPU performance optimization.Wear many hats and collaborate with the whole team for product development, deployment and customer success.Qualifications

Required

Experience in ML model or ML data pipeline deployment (on-prem or on cloud).Experience in building backend for application or platform API systems.Preferred

Working experience in fast-paced team environment.Experience in using or contributing to modern compute frameworks for LLMs (e.g. Deepspeed, Huggingface TGI, FSDP).

#J-18808-Ljbffr