vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-04-29 12:10:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

server : use different seeds for child completions (#18700)

Browse source 
* server : use different seeds for child completions

* cont : handle default seed

* cont : note
This commit is contained in:
Georgi Gerganov 2026-01-09 09:33:50 +02:00 • committed by GitHub
parent 8ece3836b4
commit f5f8812f7c
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 12 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

1
tools/server/tests/unit/test_chat_completion.py
View file

@ -503,5 +503,4 @@ def test_chat_completions_multiple_choices():
assert len(res.body["choices"]) == 2
for choice in res.body["choices"]:
assert "assistant" == choice["message"]["role"]
assert match_regex("Suddenly", choice["message"]["content"])
assert choice["finish_reason"] == "length"