Ollama became OpenAI API compatible and all rejoiced...well everyone except LiteLLM! In this video, we'll see how this makes it easier to compare OpenAI and open-source models and then we'll update a ChainLit app that I built with LiteLLM and Ollama to use Ollama via the OpenAI library instead.
Updated ChainLit app - https://github.com/mneedham/LearnData...
Ollama blog - https://ollama.com/blog/openai-compat...
OpenAI QuickStart - https://platform.openai.com/docs/quic...