List Llm Backends

GET

/v1/models/

Response

Successful Response

modelstring

LLM model name.

model_endpoint_typeenum

The endpoint type for the model.

context_windowinteger

The context window size for the model.

model_endpointstringOptional

The endpoint for the model.

model_wrapperstringOptional

The wrapper for the model.

put_inner_thoughts_in_kwargsbooleanOptionalDefaults to false

Puts ‘inner_thoughts’ as a kwarg in the function call if this is set to True. This helps with function calling performance and also the generation of inner thoughts.

handlestringOptional

The handle for this config, in the format provider/model-name.

List Embedding Backends

Up Next

Built with

1	[
2	{
3	"model": "model",
4	"model_endpoint_type": "openai",
5	"context_window": 1,
6	"model_endpoint": "model_endpoint",
7	"model_wrapper": "model_wrapper",
8	"put_inner_thoughts_in_kwargs": true,
9	"handle": "handle"
10	}
11	]

1	curl https://app.letta.com/v1/models/ \
2	-H "Authorization: Bearer <token>"