Authentication key for this provider. Shared across all model slots using the same provider.
-
-
-
-
-
+
+
+
+ chevron_right
+ Advanced Settings
-
-
-
-
-
-
API key
-
Authentication key for this provider. Shared across all model slots using the same provider.
-
-
-
-
-
-
-
+
-
-
-
-
API base URL
-
Custom endpoint URL. Leave empty to use the provider's default.
-
-
-
-
-
-
-
-
-
-
-
Context length
-
Maximum number of tokens in the context window. System prompt, chat history, RAG and response all count towards this limit.
-
-
-
-
-
-
-
-
-
-
-
-
-
Context window space for chat history
-
Portion of context window dedicated to chat history visible to the agent. Smaller size will result in shorter and more summarized history.
-
-
-
-
-
-
-
-
-
Supports Vision
-
Models capable of Vision can for example natively see the content of image attachments.
-
-
-
-
-
-
+
+
-
Max embeds
-
Maximum number of embedded images used by the chat model. Set to 0 for unlimited.
+
API key
+
Authentication key for this provider. Shared across all model slots using the same provider.
-
-
+
+
+
-
-
-
-
-
-
-
Context window space for utility model input
-
Portion of context window used for utility model input messages.
-
-
-
-
-
-
-
+
+
+
+
+
API key
+
Authentication key for this provider. Shared across all model slots using the same provider.
+
+
+
+
+
+
+
-
-
-
-
Requests per minute limit
-
Limits the number of requests per minute. Waits if the limit is exceeded. Set to 0 to disable.
-
-
-
-
-
-
-
-
-
Input tokens per minute limit
-
Limits the number of input tokens per minute. Waits if the limit is exceeded. Set to 0 to disable.
-
-
-
-
-
-
-
-
-
-
Output tokens per minute limit
-
Limits the number of output tokens per minute. Waits if the limit is exceeded. Set to 0 to disable.
+
+
+
+
API base URL
+
Custom endpoint URL. Leave empty to use the provider's default.
+
+
+
+
-
-
-
-
-
-
-
-
-
Additional parameters
-
- Any other parameters supported by LiteLLM. Format is KEY=VALUE on individual lines. Value can be JSON objects; unquoted is treated as object/number, quoted as string.
+
+
+
+
+
Context length
+
Maximum number of tokens in the context window. System prompt, chat history, RAG and response all count towards this limit.
+
+
+
+
+
+
+
+
+
+
+
+
+
Context window space for chat history
+
Portion of context window dedicated to chat history visible to the agent. Smaller size will result in shorter and more summarized history.
+
+
+
+
+
+
+
+
+
Supports Vision
+
Models capable of Vision can for example natively see the content of image attachments.
+
+
+
+
+
+
+
+
+
Max embeds
+
Maximum number of embedded images used by the chat model. Set to 0 for unlimited.
+
+
+
+
+
+
+
+
+
+
+
+
+
+
Context window space for utility model input
+
Portion of context window used for utility model input messages.
+
+
+
+
+
+
+
+
+
+
+
+
Requests per minute limit
+
Limits the number of requests per minute. Waits if the limit is exceeded. Set to 0 to disable.
+
+
+
+
-
-
-
+
+
+
+
Input tokens per minute limit
+
Limits the number of input tokens per minute. Waits if the limit is exceeded. Set to 0 to disable.
+
+
+
+
+
+
+
+
+
+
Output tokens per minute limit
+
Limits the number of output tokens per minute. Waits if the limit is exceeded. Set to 0 to disable.
+
+
+
+
+
+
+
+
+
+
+
Additional parameters
+
+ Any other parameters supported by LiteLLM. Format is KEY=VALUE on individual lines. Value can be JSON objects; unquoted is treated as object/number, quoted as string.
+