vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-28 03:39:48 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

update kvc disk path config.

Browse source
This commit is contained in:
ouqingliang 2025-06-30 15:09:35 +00:00
parent aadf31b35d
commit 90cff820cf
4 changed files with 6 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

1
doc/en/prefix_cache.md
View file

@ -14,6 +14,7 @@ kvc2:
gpu_only: false # Set to false to enable prefix cache mode (Disk + CPU + GPU KV storage)
utilization_percentage: 1.0
cpu_memory_size_GB: 500 # Amount of CPU memory allocated for KV Cache
disk_path: /mnt/data/kvc # Path to store KV Cache on disk
```
### Step 2: Update Submodules and Recompile