vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 09:04:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

reinstated the reusable buffers -> approx 10% speedup for prompt processing

Browse source
This commit is contained in:
Concedo 2023-04-22 22:49:27 +08:00
parent 811989c2ad
commit cd6c121357
2 changed files with 73 additions and 26 deletions
Download patch file Download diff file Expand all files Collapse all files

2
koboldcpp.py
View file

@ -139,7 +139,7 @@ maxctx = 2048
maxlen = 128
modelbusy = False
defaultport = 5001
KcppVersion = "1.11"
KcppVersion = "1.12"
class ServerRequestHandler(http.server.SimpleHTTPRequestHandler):
sys_version = ""