vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-28 11:49:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
kvcache-ai-ktransformers/kt-kernel/python/utils
History
callmegaga a9411f1d72
Some checks are pending
Deploy / deploy (macos-latest) (push) Waiting to run
Details
Deploy / deploy (ubuntu-latest) (push) Waiting to run
Details
Deploy / deploy (windows-latest) (push) Waiting to run
Details
Book-CI / test-1 (push) Waiting to run
Details
Book-CI / test-2 (push) Waiting to run
Details
Book-CI / test (push) Waiting to run
Details
Supports vnni-256 for GPTQ INT4 (#1926) 
* [feat](kt-kernel): support avx-vnni-256 for gptq int4
2026-04-13 17:59:59 +08:00
..
__init__.py Kt minimax (#1742) 2025-12-24 15:39:44 +08:00
amx.py Supports vnni-256 for GPTQ INT4 (#1926) 2026-04-13 17:59:59 +08:00
llamafile.py [fix]: fix --numa-nodes handling (#1904) 2026-03-31 17:50:22 +08:00
loader.py [feat](kt-kernel): support avx2 only inference for bf16 fp8 and gptq int4 (#1892) 2026-03-27 14:45:02 +08:00
moe_kernel.py [fix]: fix --numa-nodes handling (#1904) 2026-03-31 17:50:22 +08:00