Configuring your agent settings

Changing the LLM model

Configuring the max context length

Letta allows you to artificially limit the maximum context window length of your agent’s underlying LLM. Even though some LLM API providers support large context windows (e.g. 200k+), artifically constraining the LLM context window can improve your agent’s performance / stability and decrease overall cost / latency.

The max length of the context window is configurable in Letta (under “Advanced” agent settings). For example, if you’re using Claude Sonnet 3.5, but do not want the context window to exceed 16k for performance/cost/latency reasons, you can set the max context window in Letta to 16k (instead of the 200k default). When the context window reaches its max length, Letta will automatically evict old events/messages to external storage (they are not deleted, and are still accessible to the agent via tool calls).