vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-25 16:25:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fixed single token bans

Browse source
This commit is contained in:
Concedo 2026-03-07 22:50:53 +08:00
parent a40038d8e6
commit 0df18d2ae2
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
gpttype_adapter.cpp
View file

@ -3535,7 +3535,7 @@ generation_outputs gpttype_generate(const generation_inputs inputs)
{
continue;
}
if(tokcount==1 && word.length()<2) //only use banned tokens for single characters
if(tokcount==1 && word.length()<12) //only use banned tokens for single characters, we can assume that means less than 12 chars usually
{
banned_tokens.push_back(word);
}