vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-11 01:24:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

i'm gonna regret this, aren't i?

Browse source
This commit is contained in:
Concedo 2025-05-15 23:59:55 +08:00
commit 12e6928ec2
14 changed files with 237 additions and 81 deletions
Download patch file Download diff file Expand all files Collapse all files

2
include/llama.h
View file

@ -347,7 +347,7 @@ extern "C" {
float yarn_beta_fast; // YaRN low correction dim
float yarn_beta_slow; // YaRN high correction dim
uint32_t yarn_orig_ctx; // YaRN original context size
float defrag_thold; // defragment the KV cache if holes/size > thold, < 0 disabled (default)
float defrag_thold; // defragment the KV cache if holes/size > thold, <= 0 disabled (default)
ggml_backend_sched_eval_callback cb_eval;
void * cb_eval_user_data;