Test 3b - Testing Meta Llama 3.1 405B, 70B, and 8B: Windows 11 VM (60 Cores, 236 GB RAM, No GPU)
Test 3:
I used the same setup as Test 2 but reduced the amount of RAM and the number of CPU cores. VM specs: vCPU 60 cores, RAM 180GB, later increased to 236GB. In the video, you can see the usage of RAM, CPU, storage, and power, as well as the response times. I included a timer to show how quickly it responds
https://vandu.tech/meta-llama-3-1-405...
https://vandu.tech/quick-and-easy-gui...