Installation on Linux

curl -fsSL https://ollama.com/install.sh | sh

What is ollama

Open-source project to run LLMs on your local machine.

Frequently Used Commands

# setup poetry for UI
poetry run python scripts/setup

# define a specific model to be used in ollama
ollama pull model_name

# show models in local machine
ollama list

# start ollama without running the desktop application
ollama serve

# run a model in command line
ollama run model_name

# stop ollama running in the background
sudo pkill -9 ollama Ollama

## stop on linux
systemctl stop ollama.service

# remove model
ollama rm model_name

PGPT

# use poetry to install/setup PGPT
poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant"

# run PGPT
PGPT_PROFILES=ollama make run