vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 09:04:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

added token count, updated lite

Browse source
This commit is contained in:
Concedo 2023-07-20 14:41:06 +08:00
parent c49a469a79
commit 39dc1a46c4
5 changed files with 10 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

4
expose.cpp
View file

@ -223,10 +223,12 @@ extern "C"
float get_last_eval_time() {
return last_eval_time;
}
float get_last_process_time() {
return last_process_time;
}
int get_last_token_count() {
return last_token_count;
}
const char* get_pending_output() {
return gpttype_get_pending_output().c_str();