1209 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Jiaqi Liao	061fb56382	Update Kimi-K2.5.md (#1838)	2026-02-07 16:38:39 +08:00
Chen Hongtao	d342fb1df6	[docs]: add maintainers list (#1837) ... * [docs]: add maintainers list * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: ErvinXie <ervinxie@qq.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2026-02-06 18:28:06 +08:00
Oql	56cbd69ac4	kt-cli enhancement (#1834) ... * [feat]: redesign kt run interactive configuration with i18n support - Redesign kt run with 8-step interactive flow (model selection, inference method, NUMA/CPU, GPU experts, KV cache, GPU/TP selection, parsers, host/port) - Add configuration save/load system (~/.ktransformers/run_configs.yaml) - Add i18n support for kt chat (en/zh translations) - Add universal input validators with auto-retry and Chinese comma support - Add port availability checker with auto-suggestion - Add parser configuration (--tool-call-parser, --reasoning-parser) - Remove tuna command and clean up redundant files - Fix: variable reference bug in run.py, filter to show only MoE models * [feat]: unify model selection UI and enable shared experts fusion by default - Unify kt run model selection table with kt model list display * Add Total size, MoE Size, Repo, and SHA256 status columns * Use consistent formatting and styling * Improve user decision-making with more information - Enable --disable-shared-experts-fusion by default * Change default value from False to True * Users can still override with --enable-shared-experts-fusion * [feat]: improve kt chat with performance metrics and better CJK support - Add performance metrics display after each response * Total time, TTFT (Time To First Token), TPOT (Time Per Output Token) * Accurate input/output token counts using model tokenizer * Fallback to estimation if tokenizer unavailable * Metrics shown in dim style (not prominent) - Fix Chinese character input issues * Replace Prompt.ask() with console.input() for better CJK support * Fixes backspace deletion showing half-characters - Suppress NumPy subnormal warnings * Filter "The value of the smallest subnormal" warnings * Cleaner CLI output on certain hardware environments * [fix]: correct TTFT measurement in kt chat - Move start_time initialization before API call - Previously start_time was set when receiving first chunk, causing TTFT ≈ 0ms - Now correctly measures time from request sent to first token received * [docs]: 添加 Clawdbot 集成指南 - KTransformers 企业级 AI 助手部署方案 * [docs]: 强调推荐使用 Kimi K2.5 作为核心模型，突出企业级推理能力 * [docs]: 添加 Clawdbot 飞书接入教程链接 * [feat]: improve CLI table display, model verification, and chat experience - Add sequence number (#) column to all model tables by default - Filter kt edit to show only MoE GPU models (exclude AMX) - Extend kt model verify to check *.json and *.py files in addition to weights - Fix re-verification bug where repaired files caused false failures - Suppress tokenizer debug output in kt chat token counting * [fix]: fix cpu cores. --------- Co-authored-by: skqliao <skqliao@gmail.com>	2026-02-04 16:44:54 +08:00
Oql	4f64665758	[docs]: add Qwen3 Coder Next Tutorial (#1833)	2026-02-04 16:27:10 +08:00
Oql	c28cfcb26e	[fix]: fix k2-moe.hpp load weight (#1830)	2026-02-03 11:28:49 +08:00
Jiaqi Liao	794c04fae4	Revert "[doc]: update kimi_k2.5 doc (#1823)" (#1825) ... This reverts commit 2e6506535b.	2026-01-30 16:10:01 +08:00
Oql	ccbb5b1cf8	[docs]: add clawd bot docs ... add clawd bot docs	2026-01-30 15:51:30 +08:00
Jiaqi Liao	2e6506535b	[doc]: update kimi_k2.5 doc (#1823)	2026-01-30 15:43:18 +08:00
Jiaqi Liao	db82d99fa6	feat: add fallback expert prefix lookup in loader.py from kimi_k2.5 (#1822)	2026-01-30 14:09:38 +08:00
Jiaqi Liao	edc48aba37	[fix]: fix wrapper import issue (#1819)	2026-01-28 16:31:56 +08:00
Peilin Li	8321d00cc5	Add files via upload (#1814)	2026-01-27 17:44:50 +08:00
Jiaqi Liao	2f6f7f1921	Kimi k2.5 doc (#1812) ... * [doc]: add Kimi-K2.5 deploy&sft guide * [doc]: add Kimi-K2.5 deploy&sft guide	2026-01-27 13:33:25 +08:00
Jiaqi Liao	1da075a3fa	Revert "[doc]: add Kimi-K2.5 deploy&sft guide (#1810)" (#1811) ... This reverts commit a368140d76.	2026-01-27 10:05:13 +08:00
Jiaqi Liao	a368140d76	[doc]: add Kimi-K2.5 deploy&sft guide (#1810)	2026-01-27 10:02:59 +08:00
Oql	5bd5c8f750	[fix]: fix experts-sched-Tutorial.md (#1808)	2026-01-23 18:06:24 +08:00
Oql	bf4c8a690b	Add Native Precision Tutorial, update worker strategy and README.md (#1807)	2026-01-23 18:00:13 +08:00
Jianwei Dong	8652346e69	[fix]: doc (#1805)	2026-01-23 11:17:08 +08:00
SCDESPERTATE	b0f827d2a9	[chore](cuda): explicitly use ele_per_blk var for better readability (#1784)	2026-01-23 11:11:08 +08:00
Jianwei Dong	779bf14556	[doc]: add Experts sched tutorial (#1802) ... * Change num gpu experts to gpu expert masks and add eplb statistics * [feat]: update examples * [fix]: fix fp8 perchannel * Delete useless tests * Delete useless tests * add experts_sched tutorial --------- Co-authored-by: ouqingliang <1692110604@qq.com>	2026-01-22 15:40:07 +08:00
Peilin Li	a4de664e62	Add AutoDL Tutorial (#1801)	2026-01-22 14:52:47 +08:00
ErvinXie	d2305538f7	Modify installation steps in Kimi-K2-Thinking-Native.md (#1800) ... Updated installation instructions for sglang repository.	2026-01-21 15:46:21 +08:00
mrhaoxx	b27de4068b	[fix]: fix exp_avx512 for act_fn (#1797)	2026-01-20 11:07:22 +08:00
Jianwei Dong	027832c590	[feat](kt-kernel): CPU-GPU experts sched (#1796)	2026-01-16 17:01:15 +08:00
Oql	6277da4c2b	support GLM 4.7 (#1791) ... support GLM 4.7	2026-01-13 17:36:25 +08:00
watamario15	667030d6e6	[kt-kernel]: Fix ignored build configurations in install.sh and CMakeLists.txt (#1789) ... * Correct variable defaults * Remove CMAKE_BUILD_TYPE setting in CMakeLists	2026-01-12 22:16:19 +08:00
Oql	5edc456749	support Native BF16 format MoE. (#1788) ... support Native BF16 format MoE	2026-01-12 14:43:28 +08:00
Oql	ddb957596f	Fix moe bug. (#1783) ... * [fix]: fix moe.hpp load from file bug. * [fix]: fix all moe hpp init bug. * [fix]: fix moe & awq-moe ug.	2026-01-05 17:02:24 +08:00
Oql	dc6394e501	[fix]: fix moe hpp bug. (#1780) ... fix moe hpp init bug.	2026-01-04 19:32:56 +08:00
ZiWei Yuan	ad7674a6d5	[ci]: Patch ci (#1772) ... * [docs]: add kt-cli doc and update corresponding website * [feat]: update issue template	2025-12-31 12:10:20 +08:00
Jianwei Dong	6d2d7cb057	bump to 0.5.0.post1 (#1771)	2025-12-30 11:09:54 +08:00
Jianwei Dong	47b1bfcff6	Update release-pypi.yml (#1770)	2025-12-30 10:47:28 +08:00
Jianwei Dong	9adc91714f	Remove kt-kernel-cuda, kt-kernel uses the version with cuda (#1769)	2025-12-30 10:23:58 +08:00
ZiWei Yuan	b096b01fbc	[docs]: add kt-cli doc and update corresponding website (#1768)	2025-12-29 23:06:22 +08:00
ErvinXie	9539ab91eb	Cli (#1765) ... * [feat]: add custom option for kt run * [feat]: depth 3	2025-12-29 15:18:42 +08:00
Jianwei Dong	4b235cdaa4	fix cuda wheel build (#1766)	2025-12-29 12:42:06 +08:00
Jianwei Dong	7c127d9fd0	Update release-pypi.yml (#1764)	2025-12-29 11:48:55 +08:00
Jianwei Dong	559a3ad4ac	fix pypi cuda install (#1763)	2025-12-29 11:19:43 +08:00
Oql	63796374c1	[docs]: fix and add MiniMax-M2 tutorial images. (#1752)	2025-12-25 20:14:35 +08:00
Jiaqi Liao	be668074de	Update tutorial links in README.md (#1749)	2025-12-25 14:26:10 +08:00
Jiaqi Liao	46b0f36980	[feat](kt-kernel): Fix CPU instruction set variants for build & install (#1746) ... * [feat]: Enhance CPU feature detection and support for AVX512 extensions - Added cmake/DetectCPU.cmake for automatic CPU feature detection. - Updated CMakeLists.txt to include auto-detection logic for AVX512 features. - Modified install.sh to include new AVX512_VBMI option for FP8 MoE. - Enhanced _cpu_detect.py to support progressive matching of CPU variants. - Created scripts/check_cpu_features.py for manual CPU feature checks. - Updated setup.py to reflect changes in CPU variant building and environment variables. * [fix](kt-kernel): Add conditional inclusion of FP8 MoE for AVX512 BF16 support * [chore](kt-kernel): update project version to 0.5.0 in CMakeLists.txt and version.py	2025-12-24 18:57:45 +08:00
ZiWei Yuan	dc5feece8f	[docs]: update doc link (#1745)	2025-12-24 18:00:47 +08:00
ZiWei Yuan	3315335fb1	[docs]: update docs to kt-kernel & add amd_blis doc (#1744)	2025-12-24 17:55:15 +08:00
Oql	1d7a476523	[fix]: fix version to 0.5.0 (#1743)	2025-12-24 17:33:22 +08:00
ErvinXie	d8046e1bb4	Kt minimax (#1742) ... [feat]: fp8 kernel and kt-cli support	2025-12-24 15:39:44 +08:00
mrhaoxx	e7d277d163	[docs]: refine README for dpo updates (#1740) ... * [docs]: refine dpo tutorial * [docs]: refine README for dpo updates * Update doc/en/DPO_tutorial.md Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * [docs]: update website doc & refine location --------- Co-authored-by: ErvinXie <ervinxie@foxmail.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: ZiWei Yuan <yzwliam@126.com>	2025-12-24 11:20:08 +08:00
mrhaoxx	dee1e211d5	[docs]: refine dpo tutorial (#1739)	2025-12-22 18:44:24 +08:00
Peilin Li	0bce173e3b	[feat]: Release version to 0.4.4 (#1738)	2025-12-22 11:20:40 +08:00
Peilin Li	16d5d89f50	[docs]: Update Python version options in DPO tutorial (#1734)	2025-12-20 13:44:35 +08:00
Peilin Li	df998e0f36	[docs]: Add RL-DPO Tutorial (#1733)	2025-12-20 12:49:02 +08:00
Jianwei Dong	39449ed1af	update PyPI Install and readme (#1731)	2025-12-18 17:21:47 +08:00