vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-05-01 21:21:12 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Merge pull request #1307 from kvcache-ai/hyc

Browse source 
add xpu parameters to install.sh
This commit is contained in:
wang jiahao 2025-05-17 15:25:33 +08:00 • committed by GitHub
commit 32f3d7befb
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
9 changed files with 31 additions and 15 deletions
Download patch file Download diff file Expand all files Collapse all files

2
doc/en/install.md
View file

@ -117,13 +117,11 @@ Download source code and compile:
```shell
USE_BALANCE_SERVE=1 bash ./install.sh
pip install third_party/custom_flashinfer/
```
- For Multi-concurrency with two cpu and 1T RAM:
```shell
USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
pip install third_party/custom_flashinfer/
```
- For Windows (Windows native temporarily deprecated, please try WSL)