vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-21 22:35:48 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
koboldcpp/tools
History
Xuan-Son Nguyen decaf508bb
server: refactor + correctness fixes for metrics (#26920) 
* server: refactor metrics

* move most fields to server_slot_stats

* cont

* rm result_timings

* tie stats to batch

* cont

* nits: move place in code

* exclude first generated token

* more accurate batch metrics tracking

* n_predict --> n_gen

* metrics_on_prediction

* metrics_flush_idle

* metrics: seperate cache/processed prompt tokens

* refactor server_task_result_metrics

* add test

* nits

* fix flush before reset()

* cont

* rm dead code

* nits
2026-08-13 10:02:01 +02:00
..
batched-bench cmake : add install() for impl libraries + fix apple builds (#23511) 2026-05-22 11:46:26 +03:00
cli llama: add default load-mode auto, which avoids mmap on iGPUs (#26081) 2026-08-11 09:20:46 +03:00
completion llama: add default load-mode auto, which avoids mmap on iGPUs (#26081) 2026-08-11 09:20:46 +03:00
cvector-generator cmake : introduce semantic versioning (#26839) 2026-08-12 14:15:03 +02:00
export-lora docs: fix export-lora --lora-scaled syntax [no release] (#24703) 2026-06-18 16:46:17 +02:00
fit-params cmake : add install() for impl libraries + fix apple builds (#23511) 2026-05-22 11:46:26 +03:00
gguf-split cmake : introduce semantic versioning (#26839) 2026-08-12 14:15:03 +02:00
imatrix imatrix.cpp: Move finite check and only check touched experts (#26861) 2026-08-11 11:18:19 -04:00
llama-bench llama: add default load-mode auto, which avoids mmap on iGPUs (#26081) 2026-08-11 09:20:46 +03:00
mtmd cmake : introduce semantic versioning (#26839) 2026-08-12 14:15:03 +02:00
parser chat : enable tool call in thinking for DS4 (#26269) 2026-08-01 00:13:07 -05:00
perplexity perplexity : fix format specifier in LOG_ERR (#23788) 2026-05-28 10:34:58 +03:00
quantize cmake : introduce semantic versioning (#26839) 2026-08-12 14:15:03 +02:00
results libs : rename libcommon -> libllama-common (#21936) 2026-04-17 11:11:46 +03:00
rpc binaries : Improve rpc-server and export-graph-ops names. (#25045) 2026-06-27 10:31:29 +03:00
server server: refactor + correctness fixes for metrics (#26920) 2026-08-13 10:02:01 +02:00
tokenize tokenize : drop --stdin mutual-exclusion check (#25672) 2026-07-15 18:41:51 +02:00
tts mtmd: support pocket-tts (#26871) 2026-08-11 14:18:30 +02:00
ui ui: Clean up contexts, remove prop drilling from Chat Form Actions (#26951) 2026-08-13 08:21:15 +02:00
CMakeLists.txt cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053) 2026-06-04 13:13:19 +03:00