vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-06 07:09:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
4285 commits 3 branches 196 tags 374 MiB
Commit graph

2 commits

Author SHA1 Message Date
Georgi Gerganov
1da7b76569
server : fix speculative decoding with context shift (#10641) 
* server : fix speculative decoding with context shift

ggml-ci

* server : take into account speculative limits

ggml-ci

* server : add tests
 2024-12-04 22:38:20 +02:00
Xuan Son Nguyen
b782e5c7d4
server : add more test cases (#10569) 
* server : add split model test

* add test speculative

* add invalid cases
 2024-11-29 21:48:56 +01:00