Loading Safetensors with OOGABOOGA (LLM Chatbot Webui)
Oogabooga is a large scale project for running LLM chatbot models: it's creators certainly put a lot of time into developing the webapp and it shows.
Oogabooga is a great option if you have models that cannot be loaded with Llamacpp or Koboldcpp. While it does have a few functional shortcomings , it's large number of options and parameters give you plenty of room to build or explore whatever you want.
Let's get started!