Running LLMs on a Mac with llama.cpp
In this video, we learn how to install llama.cpp (a popular tool for running LLMs) using brew on a Mac. So if you want to save all the hassle of setting the right environment variables and the pain of installation with package managers like Poetry, this one's for you!
#llms #llamacpp #gguf
llama.cpp - https://github.com/ggerganov/llama.cpp
Mistral AI GGUF model - https://huggingface.co/TheBloke/Mistr...