vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-05-01 21:20:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

server : allow specifying reasoning_format in HTTP request (#15238)

Browse source
This commit is contained in:
Xuan-Son Nguyen 2025-08-11 14:48:41 +02:00 • committed by GitHub
parent 27093afe78
commit 53d0a12658
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 28 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

6
tools/server/README.md
View file

@ -1132,6 +1132,12 @@ The `response_format` parameter supports both plain JSON output (e.g. `{"type":
`chat_template_kwargs`: Allows sending additional parameters to the json templating system. For example: `{"enable_thinking": false}`
`reasoning_format`: The reasoning format to be parsed. If set to `none`, it will output the raw generated text.
`thinking_forced_open`: Force a reasoning model to always output the reasoning. Only works on certain models.
`parse_tool_calls`: Whether to parse the generated tool call.
*Examples:*
You can use either Python `openai` library with appropriate checkpoints: