vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-04-30 12:40:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

server : enable /slots by default and make it secure (#15630)

Browse source 
* server : enable /slots by default and make it secure

ggml-ci

* server : fix tests to pass `--no-slots` when necessary

* server : extend /props with info about enabled endpoints
This commit is contained in:
Georgi Gerganov 2025-08-31 20:11:58 +03:00 • committed by GitHub
parent 4efd5a8316
commit 0d161f021a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 200 additions and 47 deletions
Download patch file Download diff file Expand all files Collapse all files

2
tools/server/tests/utils.py
View file

@ -148,6 +148,8 @@ class ServerProcess:
server_args.append("--metrics")
if self.server_slots:
server_args.append("--slots")
else:
server_args.append("--no-slots")
if self.pooling:
server_args.extend(["--pooling", self.pooling])
if self.model_alias: