How much VRAM
Want to run LLMs locally?
The new NVIDIA Chat with RTX https://www.nvidia.com/en-us/ai-on-rt... requires 8GB of VRAM. Other language models require even more.
You can use the Windows utility `dxdiag` to see how much memory your NVIDIA RTX card has.
https://joe.blog.freemansoft.com/2024...