How To Run Vicuna Locally (Windows, NO GPU Required)
Download Vicuna 13b model: https://huggingface.co/eachadea/ggml-...
Download llama.cpp: https://github.com/ggerganov/llama.cp...
Join the Discord server: / discord
The $30 microphone I'm using: https://amzn.to/3VkMDKB
PUT THIS IN THE BAT FILE:
title llama.cpp
:start
main -i --interactive-first -r "### Human:" --temp 0 -c 2048 -n -1 --repeat_penalty 1.2 --instruct -m ggml-vicuna-13b-4bit.bin
pause
goto start