Oct 22, 2024

11:30 PM to 12:20 AM

How Not Diamond Saved $750K with LLM Routing Engine

Tomás Hernando Kofman

Founder and CEO of Not Diamond

Join Tomás Hernando Kofman, Founder and CEO of Not Diamond, as he unveils cost-saving strategies in large language model (LLM) deployments using smart LLM routing. This webinar covers:

  • Introduction to Not Diamond's LLM Routing Engine and how it optimizes model selection to cut costs and improve efficiency

  • Key cost-saving impact, including a 51% reduction in inference expenses

  • Live demo showcasing the routing engine in action and the simplicity of implementation with a single line of code

  • Opportunities for developers to contribute to Not Diamond's open-source projects, focusing on current development priorities