vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 17:14:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

add a space between the bench prompt to fix an issue with old bpe tokenizer stack overflow (+1 squashed commits)

Browse source 
Squashed commits:

[44a689de] add a space between the bench prompt to fix an issue with old bpe tokenizer stack overflow
This commit is contained in:
Concedo 2024-08-10 17:40:10 +08:00
parent 86e687ae8b
commit da8a96199c
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
koboldcpp.py
View file

@ -4234,7 +4234,7 @@ def main(launch_args,start_server=True):
else:
print(f"\nRunning benchmark (Not Saved)...")
if benchprompt=="":
benchprompt = "1111111111111111"
benchprompt = " 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1"
for i in range(0,14): #generate massive prompt
benchprompt += benchprompt
genout = generate(benchprompt,memory="",images=[],max_length=benchlen,max_context_length=benchmaxctx,temperature=benchtemp,top_k=benchtopk,rep_pen=benchreppen,ban_eos_token=benchbaneos)