Skip to content
Letta Platform Letta Platform Letta Docs
Sign up
API Reference
Models

List Llm Models

GET/v1/models/

List available LLM models using the asynchronous implementation for improved performance.

Returns Model format which extends LLMConfig with additional metadata fields. Legacy LLMConfig fields are marked as deprecated but still available for backward compatibility.

Query ParametersExpand Collapse
provider_category: optional array of ProviderCategory
One of the following:
"base"
"byok"
provider_name: optional string
provider_type: optional ProviderType
One of the following:
"anthropic"
"azure"
"baseten"
"bedrock"
"cerebras"
"chatgpt_oauth"
"deepseek"
"fireworks"
"google_ai"
"google_vertex"
"groq"
"hugging-face"
"letta"
"lmstudio_openai"
"minimax"
"moonshot"
"moonshot_coding"
"mistral"
"ollama"
"openai"
"together"
"vllm"
"sglang"
"openrouter"
"xai"
"zai"
"zai_coding"
ReturnsExpand Collapse
Deprecatedcontext_window: number

Deprecated: Use ‘max_context_window’ field instead. The context window size for the model.

max_context_window: number

The maximum context window for the model

Deprecatedmodel: string

Deprecated: Use ‘name’ field instead. LLM model name.

Deprecatedmodel_endpoint_type: "openai" or "anthropic" or "google_ai" or 26 more

Deprecated: Use ‘provider_type’ field instead. The endpoint type for the model.

One of the following:
"openai"
"anthropic"
"google_ai"
"google_vertex"
"azure"
"groq"
"ollama"
"webui"
"webui-legacy"
"lmstudio"
"lmstudio-legacy"
"lmstudio-chatcompletions"
"llamacpp"
"koboldcpp"
"vllm"
"hugging-face"
"baseten"
"minimax"
"moonshot"
"moonshot_coding"
"mistral"
"together"
"bedrock"
"deepseek"
"xai"
"zai"
"zai_coding"
"openrouter"
"chatgpt_oauth"
name: string

The actual model name used by the provider

provider_type: ProviderType

The type of the provider

One of the following:
"anthropic"
"azure"
"baseten"
"bedrock"
"cerebras"
"chatgpt_oauth"
"deepseek"
"fireworks"
"google_ai"
"google_vertex"
"groq"
"hugging-face"
"letta"
"lmstudio_openai"
"minimax"
"moonshot"
"moonshot_coding"
"mistral"
"ollama"
"openai"
"together"
"vllm"
"sglang"
"openrouter"
"xai"
"zai"
"zai_coding"
Deprecatedcompatibility_type: optional "gguf" or "mlx"

Deprecated: The framework compatibility type for the model.

One of the following:
"gguf"
"mlx"
display_name: optional string

A human-friendly display name for the model.

effort: optional "low" or "medium" or "high" or 2 more

The effort level for Anthropic models that support it (Opus 4.5+). Controls token spending and thinking behavior. Not setting this gives similar performance to ‘high’.

One of the following:
"low"
"medium"
"high"
"xhigh"
"max"
Deprecatedenable_reasoner: optional boolean

Deprecated: Whether or not the model should use extended thinking if it is a ‘reasoning’ style model.

Deprecatedfrequency_penalty: optional number

Deprecated: Positive values penalize new tokens based on their existing frequency in the text so far.

handle: optional string

The handle for this config, in the format provider/model-name.

Deprecatedmax_reasoning_tokens: optional number

Deprecated: Configurable thinking budget for extended thinking.

Deprecatedmax_tokens: optional number

Deprecated: The maximum number of tokens to generate.

Deprecatedmodel_endpoint: optional string

Deprecated: The endpoint for the model.

model_type: optional "llm"

Type of model (llm or embedding)

Deprecatedmodel_wrapper: optional string

Deprecated: The wrapper for the model.

Deprecatedparallel_tool_calls: optional boolean

Deprecated: If set to True, enables parallel tool calling.

Deprecatedprovider_category: optional ProviderCategory

Deprecated: The provider category for the model.

One of the following:
"base"
"byok"
provider_name: optional string

The provider name for the model.

Deprecatedput_inner_thoughts_in_kwargs: optional boolean

Deprecated: Puts ‘inner_thoughts’ as a kwarg in the function call.

Deprecatedreasoning_effort: optional "none" or "minimal" or "low" or 3 more

Deprecated: The reasoning effort to use when generating text reasoning models.

One of the following:
"none"
"minimal"
"low"
"medium"
"high"
"xhigh"
response_format: optional TextResponseFormat { type } or JsonSchemaResponseFormat { json_schema, type } or JsonObjectResponseFormat { type }

The response format for the model’s output. Supports text, json_object, and json_schema (structured outputs). Can be set via model_settings.

One of the following:
TextResponseFormat object { type }

Response format for plain text responses.

type: optional "text"

The type of the response format.

JsonSchemaResponseFormat object { json_schema, type }

Response format for JSON schema-based responses.

json_schema: map[unknown]

The JSON schema of the response.

type: optional "json_schema"

The type of the response format.

JsonObjectResponseFormat object { type }

Response format for JSON object responses.

type: optional "json_object"

The type of the response format.

return_logprobs: optional boolean

Whether to return log probabilities of the output tokens. Useful for RL training.

return_token_ids: optional boolean

Whether to return token IDs for all LLM generations via SGLang native endpoint. Required for multi-turn RL training with loss masking. Only works with SGLang provider.

strict: optional boolean

Enable strict mode for tool calling. When true, tool schemas include strict: true and additionalProperties: false, guaranteeing tool outputs match JSON schemas.

Deprecatedtemperature: optional number

Deprecated: The temperature to use when generating text with the model.

Deprecatedtier: optional string

Deprecated: The cost tier for the model (cloud only).

tool_call_parser: optional string

SGLang tool call parser name (e.g. ‘glm47’, ‘qwen25’, ‘hermes’). Used by the SGLang native adapter to parse tool calls from raw model output.

top_logprobs: optional number

Number of most likely tokens to return at each position (0-20). Requires return_logprobs=True.

Deprecatedverbosity: optional "low" or "medium" or "high"

Deprecated: Soft control for how verbose model output should be.

One of the following:
"low"
"medium"
"high"

List Llm Models

curl https://api.letta.com/v1/models/ \
    -H "Authorization: Bearer $LETTA_API_KEY"
[
  {
    "context_window": 0,
    "max_context_window": 0,
    "model": "model",
    "model_endpoint_type": "openai",
    "name": "name",
    "provider_type": "anthropic",
    "compatibility_type": "gguf",
    "display_name": "display_name",
    "effort": "low",
    "enable_reasoner": true,
    "frequency_penalty": 0,
    "handle": "handle",
    "max_reasoning_tokens": 0,
    "max_tokens": 0,
    "model_endpoint": "model_endpoint",
    "model_type": "llm",
    "model_wrapper": "model_wrapper",
    "parallel_tool_calls": true,
    "provider_category": "base",
    "provider_name": "provider_name",
    "put_inner_thoughts_in_kwargs": true,
    "reasoning_effort": "none",
    "response_format": {
      "type": "text"
    },
    "return_logprobs": true,
    "return_token_ids": true,
    "strict": true,
    "temperature": 0,
    "tier": "tier",
    "tool_call_parser": "tool_call_parser",
    "top_logprobs": 0,
    "verbosity": "low"
  }
]
Returns Examples
[
  {
    "context_window": 0,
    "max_context_window": 0,
    "model": "model",
    "model_endpoint_type": "openai",
    "name": "name",
    "provider_type": "anthropic",
    "compatibility_type": "gguf",
    "display_name": "display_name",
    "effort": "low",
    "enable_reasoner": true,
    "frequency_penalty": 0,
    "handle": "handle",
    "max_reasoning_tokens": 0,
    "max_tokens": 0,
    "model_endpoint": "model_endpoint",
    "model_type": "llm",
    "model_wrapper": "model_wrapper",
    "parallel_tool_calls": true,
    "provider_category": "base",
    "provider_name": "provider_name",
    "put_inner_thoughts_in_kwargs": true,
    "reasoning_effort": "none",
    "response_format": {
      "type": "text"
    },
    "return_logprobs": true,
    "return_token_ids": true,
    "strict": true,
    "temperature": 0,
    "tier": "tier",
    "tool_call_parser": "tool_call_parser",
    "top_logprobs": 0,
    "verbosity": "low"
  }
]