vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 17:14:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

reverted sequence mode for rwkv due to multiple issues with speed loss with bigger quantized models

Browse source
This commit is contained in:
Concedo 2023-06-14 20:03:14 +08:00
parent f83b66606b
commit 3ed3e7b7e2
4 changed files with 5 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

2
koboldcpp.py
View file

@ -224,7 +224,7 @@ maxctx = 2048
maxlen = 256
modelbusy = False
defaultport = 5001
KcppVersion = "1.30.2"
KcppVersion = "1.30.3"
class ServerRequestHandler(http.server.SimpleHTTPRequestHandler):
sys_version = ""