vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-05 20:19:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2

update readme

Browse source
This commit is contained in:
qiyuxinlin 2025-05-14 13:15:18 +00:00
parent c3d0ac80c6
commit d35d61f6a1
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
doc/en/llama4.md
View file

@ -67,7 +67,7 @@ pip3 install torch torchvision torchaudio --index-url https://download.pytorch.o
```bash
# Install single NUMA dependencies
USE_BALANCE_SERVE=1 bash ./
USE_BALANCE_SERVE=1 bash ./install.sh
pip install third_party/custom_flashinfer/
# For those who have two cpu and 1T RAM（Dual NUMA）:
USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh