Bitsandbytes use quantitizations to save VRAM so you can run larger models 👉ⓢⓤⓑⓢⓒⓡⓘⓑⓔ Thank you for watching! please consider to subscribe. thank you!
For Linux Ubuntu install, please see • Ubuntu Linux Desktop installation part 1 -...
For Linux ROCm install, see • AMD GPU Linux ROCm installation - step by ...
The AMD GPU model is 6700XT. Should work for other 6000 series AMD GPUs.
The repo url is: https://git.ecker.tech/mrq/bitsandbyt...
Please join the discord server at / discord where you can ask questions and also try out my recently developed free chatgpt bot and stable diffusion bot!
If you would like to support me, here is my Kofi link: https://ko-fi.com/techpractice and Patreon page: https://www.patreon.com/user?u=89548519
Thank you for watching!