vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-15 19:39:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

alias banned_tokens with banned_strings from ST

Browse source 
increase max bans to 32 for now
This commit is contained in:
Concedo 2024-10-10 21:52:46 +08:00
parent 5c9650d68e
commit d75cbd671d
2 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
expose.h
View file

@ -2,7 +2,7 @@
#include <cstdint>
const int stop_token_max = 24;
const int ban_token_max = 24;
const int ban_token_max = 32;
const int tensor_split_max = 16;
const int logit_bias_max = 24;
const int dry_seq_break_max = 24;