HOW TO: Chat with LLAMA3-8B Locally Without Internet
1. Go to https://ollama.com/
2. Click ‘Download’
3. Choose your OS. For me, it’s ‘Windows’
4. After downloading, find the .exe file in your Downloads/ and go ahead with the installation
5. Go back to ollama, click ‘Models’, and ‘Llama3’
6. Copy the command ‘ollama run llama3’ (which is the 8b parameter model)
7. Paste and execute in your terminal. This will download the llama3-8b model (4.7gb). It only needs to be downloaded once. Next time you use it, it will be ready for prompting.
8. Now you can chat with Llama right on your laptop without an internet connection.
9. To end the chat: `/bye`