Groq
To use Letta with Groq, set the environment variable
GROQ_API_KEY=...
You can use Letta with Groq if you have a Groq account and API key. Once you have set your GROQ_API_KEY
in your environment variables, you can select what model and configure the context window size.
Enabling Groq as a provider
To enable the Groq provider, you must set the GROQ_API_KEY
environment variable. When this is set, Letta will use available LLM models running on Groq.