Docker

Although Letta Code can technically be run with any open weights model (e.g. via Ollama), it is a very demanding agent harness, and you are unlikely to get good performance with most open weights models outside of the very best ones (e.g. GLM-4.7, MiniMax M2.1).

We strongly recommend new Letta Code users first experiment with frontier models (e.g. Claude Opus 4.5 or GPT-5.2) to understand Letta Code’s capabilities before experimenting with open weights models.

Letta Code can connect to a Letta server running in Docker by setting LETTA_BASE_URL.

Prerequisites

Before connecting Letta Code, you need to have a Letta server running in Docker. See the Docker setup guide for detailed instructions.

This example command configures a Letta server with an OpenAI API key, an Anthropic API key (for Claude models), and an Ollama URL (assumes that Ollama is running on localhost:11434):

docker run \
  -v ~/.letta/.persist/pgdata:/var/lib/postgresql/data \
  -p 8283:8283 \
  -e OPENAI_API_KEY="your_openai_api_key" \
  -e ANTHROPIC_API_KEY="your_anthropic_api_key" \
  -e OLLAMA_BASE_URL="http://host.docker.internal:11434/v1" \
  letta/letta:latest

Connecting Letta Code

Set the LETTA_BASE_URL environment variable to point to your server:

export LETTA_BASE_URL="http://localhost:8283"

Then run Letta Code normally:

letta

You can also set it inline:

LETTA_BASE_URL="http://localhost:8283" letta

Models available on the Letta server running in Docker will be shown in /model.