mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2025-09-06 12:40:02 +00:00
update readme
This commit is contained in:
parent
c3d0ac80c6
commit
d35d61f6a1
1 changed files with 1 additions and 1 deletions
|
@ -67,7 +67,7 @@ pip3 install torch torchvision torchaudio --index-url https://download.pytorch.o
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
# Install single NUMA dependencies
|
# Install single NUMA dependencies
|
||||||
USE_BALANCE_SERVE=1 bash ./
|
USE_BALANCE_SERVE=1 bash ./install.sh
|
||||||
pip install third_party/custom_flashinfer/
|
pip install third_party/custom_flashinfer/
|
||||||
# For those who have two cpu and 1T RAM(Dual NUMA):
|
# For those who have two cpu and 1T RAM(Dual NUMA):
|
||||||
USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
|
USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
|
||||||
|
|
Loading…
Add table
Reference in a new issue