vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 09:04:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

updated lite, improve horde worker (+1 squashed commits)

Browse source 
Squashed commits:

[a7c25999] improve horde worker
This commit is contained in:
Concedo 2023-10-03 23:43:13 +08:00
parent ae8ccdc1be
commit 0cc740115d
3 changed files with 98 additions and 40 deletions
Download patch file Download diff file Expand all files Collapse all files

5
gpttype_adapter.cpp
View file

@ -1722,7 +1722,10 @@ generation_outputs gpttype_generate(const generation_inputs inputs, generation_o
if(inputs.unban_tokens_rt && id==eosID)
{
stopper_unused_tokens = remaining_tokens;
printf("\n(EOS token triggered!)");
if(debugmode!=-1)
{
printf("\n(EOS token triggered!)");
}
remaining_tokens = 0;
last_stop_reason = stop_reason::EOS_TOKEN;
}