Together
To use Letta with Together.AI, set the environment variable
TOGETHER_API_KEY=...
You can use Letta with Together.AI if you have an account and API key. Once you have set your TOGETHER_API_KEY
in your environment variables, you can select what model and configure the context window size.
Enabling Together.AI as a provider
To enable the Together.AI provider, you must set the TOGETHER_API_KEY
environment variable. When this is set, Letta will use available LLM models running on Together.AI.
Using the docker run
server with Together.AI
To enable Together.AI models, simply set your TOGETHER_API_KEY
as an environment variable:
CLI (pypi only)
Using letta run
and letta server
with Together.AI
To chat with an agent, run:
This will prompt you to select a model:
To run the Letta server, run:
To select the model used by the server, use the dropdown in the ADE or specify a LLMConfig
object in the Python SDK.