mirror of
https://github.com/Lizonghang/prima.cpp.git
synced 2025-09-09 09:34:33 +00:00
llama: enable K-shift for quantized KV cache It will fail on unsupported backends or quant types. |
||
---|---|---|
.. | ||
cmake | ||
include | ||
src | ||
.gitignore | ||
CMakeLists.txt |