vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-13 02:16:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

server: support "reasoning_effort": "none" in OAI API (#26045)

Browse source 
* support "reasoning_effort": "none" in OAI API

* handle reasoning.effort: "none" in OAI responses API

* clarify non-"none" values of reasoning_effort have no effect

* use json_value instead of body.at
This commit is contained in:
Nigel Bosch 2026-07-24 12:19:10 -05:00 • committed by GitHub
parent 298219f985
commit 27209a598d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
3 changed files with 19 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
tools/server/server-common.cpp
View file

@ -1086,6 +1086,14 @@ json oaicompat_chat_params_parse(
throw std::invalid_argument("invalid type for \"enable_thinking\" (expected boolean, got string)");
}
// Parse also the OAI "reasoning_effort": "none" specific value
if (body.contains("reasoning_effort")) {
auto reasoning_effort = json_value(body, "reasoning_effort", std::string(""));
if (reasoning_effort == "none") {
inputs.enable_thinking = false;
} // other reasoning_effort values are model-specific and not yet handled
}
inputs.force_pure_content = opt.force_pure_content;
// Apply chat template to the list of messages