vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-15 01:29:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #1099 from kvcache-ai/Atream-patch-3

Browse source 
Update llama4.md
This commit is contained in:
Atream 2025-04-09 18:01:46 +08:00 • committed by GitHub
commit a46c43b2db
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
doc/en/llama4.md
View file

@ -71,7 +71,7 @@ USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
Make sure you have:
- `--model_path` pointing to a local config directory (not a Hugging Face name).
- `--gguf_path` pointing to quantized `.gguf` weights.
- `--gguf_path` pointing to the folder containing quantized `.gguf` weights.
```bash
python ktransformers/server/main.py \