vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-05-05 15:40:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

update default config

Browse source
This commit is contained in:
qiyuxinlin 2025-05-13 12:20:21 +00:00
parent 8456222852
commit 697444905a
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
ktransformers/configs/config.yaml
View file

@ -29,7 +29,7 @@ model:
gguf_path: ./DeepSeek-V2-Lite-Chat-GGUF
device: cuda:0
cache_lens: 8192
cache_lens: 16384
max_new_tokens: 500
web:
mount: False