vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-05-16 19:59:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

only fetch new popped horde requests if model is not blocked queue

Browse source
This commit is contained in:
Concedo 2026-05-16 22:27:12 +08:00
parent 80ce8a50b3
commit 3095da076a
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
koboldcpp.py
View file

@ -9448,8 +9448,8 @@ def run_horde_worker(args, api_key, worker_name, worker_id, parallel_batching_th
time.sleep(1)
continue
#first, make sure we are not generating
if parallel_batching_threads<=1 and modelbusy.locked():
#first, make sure we are not generating (queue is empty)
if modelbusy.locked():
time.sleep(0.2)
continue