vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 17:14:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fixed a bug with token timings, updated lite

Browse source
This commit is contained in:
Concedo 2023-06-20 20:41:42 +08:00
parent c5ae3f50a7
commit 537ff22ec9
2 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

1
gpttype_adapter.cpp
View file

@ -1265,6 +1265,7 @@ generation_outputs gpttype_generate(const generation_inputs inputs, generation_o
if(unbanTokens && id==eosID)
{
stopper_unused_tokens = remaining_tokens;
printf("\n(EOS token triggered!)");
remaining_tokens = 0;
}