Hugging Face GGUF Models locally with Ollama
In this video, we'll learn how to download and run Hugging Face language models in GGUF format on your local machine using Ollama. We'll also take a look at performance metrics using asitop, a monitoring tool that works on Apple Silicon.
#HuggingFace #GGUF #ollama #llms
Blog post - https://www.markhneedham.com/blog/202...
asitop - https://github.com/tlkh/asitop
Hugging Face - https://huggingface.co/
Ollama - https://ollama.ai/