vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-16 20:09:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

expose some useful info that can be used in statistics of performence

Browse source
This commit is contained in:
shutup 2023-07-07 11:52:58 +08:00
parent 3d2907d208
commit 1727e652f1
4 changed files with 20 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
expose.h
View file

@ -54,3 +54,5 @@ extern std::string lora_filename;
extern std::string lora_base;
extern std::vector<std::string> generated_tokens;
extern bool generation_finished;
extern float prompt_eval_time;
extern float prompt_process_time;