vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-29 04:09:52 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

[fix]: fix --numa-nodes handling (#1904)
Some checks are pending
Book-CI / test (push) Waiting to run
Details
Book-CI / test-1 (push) Waiting to run
Details
Book-CI / test-2 (push) Waiting to run
Details
Deploy / deploy (macos-latest) (push) Waiting to run
Details
Deploy / deploy (ubuntu-latest) (push) Waiting to run
Details
Deploy / deploy (windows-latest) (push) Waiting to run
Details
Release sglang-kt to PyPI / Build sglang-kt wheel (push) Waiting to run
Details
Release sglang-kt to PyPI / Publish sglang-kt to PyPI (push) Blocked by required conditions
Details

Browse source 
* [fix]: fix --numa-nodes handling
This commit is contained in:
Oql 2026-03-31 17:50:22 +08:00 • committed by GitHub
parent cdc867c864
commit 9e6484a538
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 43 additions and 13 deletions
Download patch file Download diff file Expand all files Collapse all files

1
kt-kernel/python/utils/llamafile.py
View file

@ -41,6 +41,7 @@ class LlamafileMoEWrapper(BaseMoEWrapper):
cpu_save: bool = False,
max_deferred_experts_per_token: Optional[int] = None,
method: str = "LLAMAFILE",
numa_nodes: Optional[List[int]] = None,
):
"""
Initialize Llamafile MoE Wrapper.