vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-05-22 03:10:03 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

kobo cheats death again (+1 squashed commits)

Browse source 
Squashed commits:

[708e2429] kobo cheats death again
This commit is contained in:
Concedo 2025-01-04 00:49:04 +08:00
parent f9f1585a7f
commit b4dc29f425
10 changed files with 225 additions and 46 deletions
Download patch file Download diff file Expand all files Collapse all files

2
include/llama.h
View file

@ -631,8 +631,6 @@ extern "C" {
llama_pos p0,
llama_pos p1);
LLAMA_API void printcache(struct llama_context * ctx);
// Copy all tokens that belong to the specified sequence to another sequence
// Note that this does not allocate extra KV cache memory - it simply assigns the tokens to the new sequence
// p0 < 0 : [0, p1]