AMD GPU run Ollama (Llama 3.1)
Ollama now supports AMD GPU. How fast is the speed? this video shows it! #llm #GPU #AMD #ollama #llama #llama3.1
👉ⓢⓤⓑⓢⓒⓡⓘⓑⓔ
Platform: Linux (Ubuntu 20.04)
GPU: AMD 6700XT
For installation of ROCm, see • AMD GPU Linux ROCm installation - step by ...
For installation of Ollama: • Ollama added Windows support to run local ...
Ollama Benchmark (Nvidia GPU, AMD GPU, CPU, Macbooks): • LLM Benchmarking Ollama - 9 Intel/AMD/Nvid...
Affiliate links: buy hardware on Amazon
AMD GPU: https://amzn.to/3vCp6h1
4600G https://amzn.to/45LhGFa
5600G: https://amzn.to/3LgnFtC (same iGPU, better CPU)
5700G: https://amzn.to/3Z9gUiM (better iGPU, and better CPU)
ssd drive: https://amzn.to/3MVJdg2
DDR4 drive: https://amzn.to/3sKNufi
AM4 motherboard: https://amzn.to/3GfrPit
PSU (power supply unit): https://amzn.to/3Gd87UA
PC Case: https://amzn.to/3QPDNnF
if you are interested in discrete GPU: https://amzn.to/3QT1wDp
Please join the discord server at / discord where you developed free chatgpt bot and stable diffusion bot!
If you would like to support me, here is my Kofi link: https://ko-fi.com/techpractice and Patreon page: https://www.patreon.com/user?u=89548519
Thank you for watching!