vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-17 04:19:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

added stop reason in the perf endpoint

Browse source
This commit is contained in:
Concedo 2023-07-24 11:55:35 +08:00
parent 910744e2c0
commit 280abaf029
4 changed files with 18 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

3
expose.cpp
View file

@ -229,6 +229,9 @@ extern "C"
int get_last_token_count() {
return last_token_count;
}
int get_last_stop_reason() {
return (int)last_stop_reason;
}
const char* get_pending_output() {
return gpttype_get_pending_output().c_str();