koboldcpp/ggml
Aman Gupta f8f0a47a55
cuda: reserve space for quantize kv-cache at startup (#23907)
* cuda: reserve space for quantize kv-cache at startup

* address review comments

* remove forward decl

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* remove assert in ggml-cuda.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2026-06-03 18:39:59 +08:00
..
cmake ggml : Parallelize quant LUT init (#23595) 2026-05-25 10:15:46 +03:00
include TP: quantized KV cache support (#23792) 2026-06-01 12:30:10 +02:00
src cuda: reserve space for quantize kv-cache at startup (#23907) 2026-06-03 18:39:59 +08:00
.gitignore vulkan : cmake integration (#8119) 2024-07-13 18:12:39 +02:00
CMakeLists.txt ggml : bump version to 0.13.1 (ggml/1523) 2026-05-29 09:56:08 +03:00