Deploying large language models on Ubuntu servers

Created on July 21, 2025 , last updated on July 21, 2025

2025   ·   deployment   LLM   Ubuntu   ·   computer

Go to this page and run the command on your server as root.

Change path to read the models

Environment="OLLAMA_MODELS=/path/to/models"

Note that the owner of the model folder must be ollama.

Check port usage

sudo apt install net-tools

sudo netstat -ntlp