vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-04-28 03:30:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

server : enable multi-modal prompt caching (#19877)

Browse source
This commit is contained in:
Georgi Gerganov 2026-02-25 15:15:42 +02:00 • committed by GitHub
parent d7d826b3c1
commit f20469d919
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 1 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

3
tools/server/server-context.cpp
View file

@ -995,9 +995,6 @@ private:
// don't update the cache if the slot's context is empty
update_cache = update_cache && tokens.size() > 0;
// TODO: mtmd does not support prompt cache
update_cache = update_cache && (ret->mctx == nullptr);
if (update_cache) {
SRV_WRN("%s", "updating prompt cache\n");