kvcache-ai-ktransformers/doc/en/kt-kernel
mrhaoxx 7a9daf0cd4
Some checks are pending
Book-CI / test (push) Waiting to run
Book-CI / test-1 (push) Waiting to run
Book-CI / test-2 (push) Waiting to run
Deploy / deploy (macos-latest) (push) Waiting to run
Deploy / deploy (ubuntu-latest) (push) Waiting to run
Deploy / deploy (windows-latest) (push) Waiting to run
[feat](kt-kernel): support avx2 only inference for bf16 fp8 and gptq int4 (#1892)
* feat: support avx2 bf16 fp8 inference

* feat: support avx2 gptq int4 inference

* fix: numeric issues in fp8 dequant

* Tutorial avx2 (#1900)

* fix: prevent injecting -DLLAMA_AVX512=ON on AVX2-only machines

* docs: add AVX2 tutorial for running KTransformers on AVX2-only CPUs

* Tutorial avx2 (#1901)

* fix: prevent injecting -DLLAMA_AVX512=ON on AVX2-only machines

* docs: add AVX2 tutorial for running KTransformers on AVX2-only CPUs

* docs: update README.md

---------

Co-authored-by: Benjamin F <159887351+yyj6666667@users.noreply.github.com>
2026-03-27 14:45:02 +08:00
..
amd_blis.md [docs]: update docs to kt-kernel & add amd_blis doc (#1744) 2025-12-24 17:55:15 +08:00
AVX2-Tutorial.md [feat](kt-kernel): support avx2 only inference for bf16 fp8 and gptq int4 (#1892) 2026-03-27 14:45:02 +08:00
deepseek-v3.2-sglang-tutorial.md Fix/sglang kt detection (#1875) 2026-03-04 16:54:48 +08:00
experts-sched-Tutorial.md Fix/sglang kt detection (#1875) 2026-03-04 16:54:48 +08:00
GLM-5-Tutorial.md Fix/sglang kt detection (#1875) 2026-03-04 16:54:48 +08:00
Kimi-K2-Thinking-Native.md Fix/sglang kt detection (#1875) 2026-03-04 16:54:48 +08:00
kt-cli.md [docs]: add kt-cli doc and update corresponding website (#1768) 2025-12-29 23:06:22 +08:00
kt-kernel_intro.md [docs]: improve docs structure (#1623) 2025-11-16 12:40:59 +08:00
MiniMax-M2.1-Tutorial.md Fix/sglang kt detection (#1875) 2026-03-04 16:54:48 +08:00
Native-Precision-Tutorial.md Fix/sglang kt detection (#1875) 2026-03-04 16:54:48 +08:00
Qwen3-Coder-Next-Tutorial.md Fix/sglang kt detection (#1875) 2026-03-04 16:54:48 +08:00
README.md [docs]: add kt-cli doc and update corresponding website (#1768) 2025-12-29 23:06:22 +08:00

kt-kernel Docs