Local LLM- Model on your Device
Get up and running with large language models, locally on your PC or Mac.
Run Llama 3.1, Code Llama, and other models.
Step 1: Install Ollama https://ollama.com/ on your PC
Step 2: Copy and Paste Llama 3 install command using Terminal
Step 3: Install Docker https://www.docker.com/
Step 4: Install OpenWebUI only step you need
docker run -d -p 3000:8080 -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama