vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 09:04:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

dry is still buggy because token indexes are wrong

Browse source
This commit is contained in:
Concedo 2024-08-21 00:59:26 +08:00
parent db6ef8d1e1
commit 6a4becb731
1 changed files with 4 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

4
gpttype_adapter.cpp
View file

@ -698,6 +698,10 @@ void sample_dry(int n_ctx, int penalty_range, float penalty_multiplier, float pe
candidates->data[token].logit -= penalty;
++count;
}
if(count>0)
{
candidates->sorted = false;
}
if (debugmode==1 && !dry_max_token_repeat.empty()) {
printf("]\n");
}