AWS Bedrock
We support Anthropic models provided via AWS Bedrock.
To use a model with AWS Bedrock, you must ensure it is enabled in the your AWS Model Catalog. Letta will list all available Anthropic models on Bedrock, even if you do not have access to them via AWS.
Enabling AWS Bedrock models
To enable the AWS Bedrock provider, set your key as an environment variable:
Now, AWS Bedrock models will be enabled with you run the Letta server.
Using the docker run
server with AWS Bedrock
To enable AWS Bedrock models, simply set your AWS_ACCESS_KEY
, AWS_SECRET_ACCESS_KEY
, and AWS_REGION
as environment variables:
CLI (pypi only)
Using letta run
and letta server
with AWS Bedrock
To chat with an agent, run:
To run the Letta server, run:
To select the model used by the server, use the dropdown in the ADE or specify a LLMConfig
object in the Python SDK.