Oct 22, 2024
11:30 PM to 12:20 AM
How Not Diamond Saved $750K with LLM Routing Engine
Tomás Hernando Kofman
Founder and CEO of Not Diamond
Join Tomás Hernando Kofman, Founder and CEO of Not Diamond, as he unveils cost-saving strategies in large language model (LLM) deployments using smart LLM routing. This webinar covers:
Introduction to Not Diamond's LLM Routing Engine and how it optimizes model selection to cut costs and improve efficiency
Key cost-saving impact, including a 51% reduction in inference expenses
Live demo showcasing the routing engine in action and the simplicity of implementation with a single line of code
Opportunities for developers to contribute to Not Diamond's open-source projects, focusing on current development priorities