models

List LLM Models

List available LLM models using the asynchronous implementation for improved performance. Returns Model format which extends LLMConfig with additional metadata fields. Legacy LLMConfig fields are marked as deprecated but still available for backward compatibility.

Authentication

AuthorizationBearer

Header authentication of the form Bearer <token>

Query Parameters

provider_categorylist of enums or nullOptional
Allowed values:
provider_namestring or nullOptional
provider_typeenum or nullOptional

Response

Successful Response
namestring
The actual model name used by the provider
provider_typeenum
The type of the provider
max_context_windowinteger
The maximum context window for the model
modelstringDeprecated

Deprecated: Use ‘name’ field instead. LLM model name.

model_endpoint_typeenumDeprecated

Deprecated: Use ‘provider_type’ field instead. The endpoint type for the model.

context_windowintegerDeprecated

Deprecated: Use ‘max_context_window’ field instead. The context window size for the model.

handlestring or null

The handle for this config, in the format provider/model-name.

display_namestring or null

A human-friendly display name for the model.

provider_namestring or null
The provider name for the model.
model_type"llm" or null

Type of model (llm or embedding)

model_endpointstring or nullDeprecated

Deprecated: The endpoint for the model.

provider_categoryenum or nullDeprecated

Deprecated: The provider category for the model.

Allowed values:
model_wrapperstring or nullDeprecated

Deprecated: The wrapper for the model.

put_inner_thoughts_in_kwargsboolean or nullDefaults to trueDeprecated

Deprecated: Puts ‘inner_thoughts’ as a kwarg in the function call.

temperaturedouble or nullDefaults to 0.7Deprecated

Deprecated: The temperature to use when generating text with the model.

max_tokensinteger or nullDeprecated

Deprecated: The maximum number of tokens to generate.

enable_reasonerboolean or nullDefaults to trueDeprecated

Deprecated: Whether or not the model should use extended thinking if it is a ‘reasoning’ style model.

reasoning_effortenum or nullDeprecated

Deprecated: The reasoning effort to use when generating text reasoning models.

Allowed values:
max_reasoning_tokensinteger or nullDefaults to 0Deprecated

Deprecated: Configurable thinking budget for extended thinking.

frequency_penaltydouble or nullDeprecated

Deprecated: Positive values penalize new tokens based on their existing frequency in the text so far.

compatibility_typeenum or nullDeprecated

Deprecated: The framework compatibility type for the model.

Allowed values:
verbosityenum or nullDeprecated

Deprecated: Soft control for how verbose model output should be.

Allowed values:
tierstring or nullDeprecated

Deprecated: The cost tier for the model (cloud only).

parallel_tool_callsboolean or nullDefaults to falseDeprecated

Deprecated: If set to True, enables parallel tool calling.

Errors