Skip to content
Snippets Groups Projects

RAG app

Installation

Use the docker to install RAG.

RAG container

Build RAG app image

docker build -t streamlit-app .

Run builded image

docker run -p 8501:8501 --env-file .env streamlit-app

Ollama container

Pull Ollama image

docker pull ollama/ollama

Run the Ollama container

docker run -d --name my-ollama -p 11434:11434 ollama/ollama

Use docker compose instead

Build image and start

docker compose up --build

Access the ollama container

docker compose exec ollama bash

Pull needed LLM models

ollama pull llama3.1:latest
ollama pull nomic-embed-text