vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 17:14:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

cuda free only for non mmq (+2 squashed commit)

Browse source 
Squashed commit:

[3aca763a] only cuda free for non mmq

[e69a8c9f] revert to pool alloc to try again
This commit is contained in:
Concedo 2023-08-07 16:40:13 +08:00
parent 9f16a4c4ef
commit cae6a847ad
2 changed files with 31 additions and 35 deletions
Download patch file Download diff file Expand all files Collapse all files

2
koboldcpp.py
View file

@ -303,7 +303,7 @@ maxhordectx = 1024
maxhordelen = 256
modelbusy = threading.Lock()
defaultport = 5001
KcppVersion = "1.39"
KcppVersion = "1.39.1"
showdebug = True
showsamplerwarning = True
showmaxctxwarning = True