Prerequisites
Before diving in, ensure the following:
Operating System: Ubuntu 22.04 or a similar Linux distribution. (Debian/Debian-based will make your life easier)
Hardware: Modern CPU with at least 16 GB of RAM; a dedicated GPU. (NVIDIA GPUs are already well tested)
Software: Python 3.8 or later, and Git installed on your system. (Probably already installed, check first)
Free disk space: At least 10 GB of for smaller models; larger models like 671b require significantly more!!
curl -fsSL https://ollama.com/install.sh | sh
ollama --version
systemctl is-active ollama.service
sudo systemctl start ollama.service
To always start the service when your system boots run:
sudo systemctl enable ollama.service
To download and run the 7b model, use the command:
ollama run deepseek-r1:7b
To download and run the 1.5b model, use the command:
ollama run deepseek-r1:1.5b
The download size for these models varies:
1.5b: ~2.3GB
7b: ~4.7GB
70b: ~40GB+
#deepseek #linux #LLMs #largelanguagemodel #chatgpt #chatgptvsdeepseek