Commit graph

Select branches

Hide pull requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/gosim-2026-and-roadmap-link

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#220

#224

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

Mono Color

• f077d5a5f2 [build]: sync sglang submodule to 04653fa88f5ce4ea83632c4ad436343db6bc8324 auto/sync-sglang ovowei 2026-07-24 10:03:17 +00:00
• a8062bfa7e
  release: bump version to 0.6.4 (#2105) main yyj 2026-07-23 22:42:28 +08:00
• 924754a00b
  [feat](kt-kernel): end-to-end full-parameter and LoRA SFT(#2094) v0.6.4 yyj 2026-07-23 21:23:34 +08:00
• d1a3ed8a30
  [perf]: add K2 RAWINT4 prefill mat-mat dispatch (#2080) yyj 2026-07-19 21:43:01 +08:00
• 937f61c988
  [fix](kt-kernel): AVX-VNNI-256 RAWINT4 per-expert weight loading (#2092) Aaryan Mehta 2026-07-19 05:24:52 -04:00
• def0f9313d
  fix(security): bind balance_serve scheduler ZMQ socket to loopback (#2087) (#2091) Tai An 2026-07-18 20:38:22 -07:00
• 821f3b6198 deploy: 0c2912a5e2 gh-pages yyj6666667 2026-07-17 08:24:56 +00:00
• 0c2912a5e2
  [feat] Add SYCL backend for intel iGPU (#2089) callmegaga 2026-07-17 16:24:04 +08:00
• 01fdfa609e
  docs(DSV4): add supplementary deployment and tuning notes Graham 2026-07-15 00:06:58 -05:00
• ef590428a1 deploy: 7c021b430c yyj6666667 2026-07-10 03:21:48 +00:00
• 7c021b430c
  [chore](sglang): bump sglang submodule for FP16 FE8M0 Marlin fix (#2082) callmegaga 2026-07-10 11:18:45 +08:00
• cb9f47d142
  [fix](cli): detect bound ports before launch (#2071) VectorPeak 2026-07-06 18:25:31 +08:00
• 79b265b2f6
  fix: normalize compressed RAWINT4 weights (#2075) lutianshu824 2026-07-06 18:06:52 +08:00
• d076e63b25
  Merge b1b2174a87 into 8e46e5896c Shaurya Omar 2026-06-25 20:38:30 +00:00
• b1b2174a87 feat(kt-kernel): add score-aware expert placement Shaurya Omar 2026-06-26 01:39:42 +05:30
• 8e46e5896c
  release: bump version to 0.6.3.post1 (#2063) v0.6.3.post1 Benjamin 2026-06-25 22:42:55 +08:00
• 99cf022b0a release: bump version to 0.6.3.post1 yyj 2026-06-25 22:38:00 +08:00
• 93078f8231 ci(release-pypi): set up Python in publish-pypi job (fixes PEP 668) yyj 2026-06-25 22:18:05 +08:00
• 0e73671b18
  Merge 97c033d817 into 459df61262 devangpratap 2026-06-25 12:46:29 +00:00
• 531cbcbf39
  Merge 48b628c358 into 459df61262 sysy 2026-06-25 12:46:28 +00:00
• 459df61262
  [build] Sync sglang-kt submodule (v0.6.3) (#2055) github-actions[bot] 2026-06-25 20:41:04 +08:00
• 4317bff7f8 ci(release-pypi): target manylinux_2_35 (build host glibc), drop dishonest fallback yyj 2026-06-25 20:31:53 +08:00
• f8fd344610 ci(release-pypi): verify wheel inside $RUNNER_TEMP, not /tmp yyj 2026-06-25 16:59:32 +08:00
• c02eac80a9 ci(release-pypi): skip apt-get on self-hosted runners; split pip indexes yyj 2026-06-25 15:59:15 +08:00
• a5764116c5 Merge remote-tracking branch 'upstream/main' into push-to-pr-2055 yyj 2026-06-25 20:37:26 +08:00
• a0c7431187
  ci(release-pypi): make release pipeline self-consistent (#2062) Benjamin 2026-06-25 20:05:06 +08:00
• 59f028ff80 [build]: sync sglang submodule to 5d6bef9f61637aaeaf047bf8209def2af3eaa83f ovowei 2026-06-25 09:11:05 +00:00
• 42fb35eb7a ci(release-pypi): make release pipeline self-consistent and Blackwell-ready yyj 2026-06-25 15:24:03 +08:00
• 808b549c16 deploy: 983a88b620 yyj6666667 2026-06-24 07:23:06 +00:00
• 7c752ebd30 deploy: 08d70e8605 yyj6666667 2026-06-24 07:22:49 +00:00
• ecdeeb9923 deploy: 983a88b620 yyj6666667 2026-06-24 07:14:42 +00:00
• 983a88b620
  docs: add FAQ entry about SGLang MoE kernel config warning (#2029) Willow Lopez 2026-06-24 15:12:54 +08:00
• 8db3561516
  Update GPU architecture support information Benjamin 2026-06-24 15:12:21 +08:00
• 08d70e8605
  [fix](kt-kernel): enable -mavx512vl for AVX512_VBMI/BF16 multi-variant builds (#2021) Hermann Hans Klie 2026-06-24 09:05:36 +02:00
• 7dffc947e5
  Clean up AVX512 flags section in CMakeLists.txt Benjamin 2026-06-24 15:04:56 +08:00
• 0a7785423a [fix](security): HMAC-authenticate scheduler RPC to prevent pickle deserialization RCE devangpratap 2026-06-23 17:55:56 -04:00
• 9924c9f1bb deploy: 1ed332b6ea jdai0 2026-06-23 12:52:37 +00:00
• 1ed332b6ea
  [docs]: clean up Qwen3.5 KT LoRA serving guide (#2057) Jiaheng Dai 2026-06-23 20:52:23 +08:00
• 4e10cb4a7c
  Update doc/zh/Qwen3.5-SGLang-LoRA-Serving_zh.md Jiaheng Dai 2026-06-23 20:44:52 +08:00
• d46d5b65b8 [docs]: clean up Qwen3.5 KT LoRA serving guide djh 2026-06-23 12:40:47 +00:00
• 19fc69d597 deploy: c884dbd221 yyj6666667 2026-06-21 09:55:38 +00:00
• c884dbd221
  release: bump version to 0.6.3 (#2054) Benjamin 2026-06-21 17:55:24 +08:00
• e03c014465 release: bump version to 0.6.3 yyj 2026-06-21 17:51:25 +08:00
• ce7c3ddbe9
  [build]: sync sglang submodule to 8b636f9008dbad58c0a8e481b03e794739e6c146 (#2047) v0.6.3 github-actions[bot] 2026-06-21 17:37:52 +08:00
• 597e051a6d [build]: sync sglang submodule to 8b636f9008dbad58c0a8e481b03e794739e6c146 ovowei 2026-06-21 09:19:09 +00:00
• 6c9c95601d
  [fix](kt-kernel): CudaGraph replay fix and Add MoE startup log (#2037) Benjamin 2026-06-18 17:15:37 +08:00
• 3ffa8871aa fix(kt-kernel/cpuinfer): drop delete args — UAF under CUDA Graph replay yyj 2026-06-18 16:41:30 +08:00
• f95dd3f0d2 [fix](kt-kernel): clarify AMX vs AVX512-BF16 backend in MoE startup log yyj 2026-06-09 13:19:45 +08:00
• 73d611fe2a revert(kt-kernel/cpuinfer): drop delete args from sync_ callback yyj 2026-06-18 16:32:20 +08:00
• 943cc4daeb
  [feat] MXFP8 MoE support (#2041) Benjamin 2026-06-18 16:18:49 +08:00
• a50a505408 refactor(avx2/mxfp8): wire backend + swigluoai activation yyj 2026-06-18 15:21:00 +08:00
• 21d5b40323
  docs(deepseek-v4-flash): pin apache-tvm-ffi<0.1.12 to avoid tilelang TVM FFI registration clash (#2045) (#2048) Tai An 2026-06-17 20:10:56 -07:00
• 50d9434800
  [docs](kt-kernel): add MiniMax-M3 SGLang + KT-Kernel tutorial (#2051) Benjamin 2026-06-18 10:40:51 +08:00
• 3b02827282 [docs](kt-kernel): add MiniMax-M3 SGLang + KT-Kernel tutorial yyj 2026-06-18 10:36:47 +08:00
• ee0274e63b docs(deepseek-v4-flash): move apache-tvm-ffi pin rationale into a Note blockquote Tai An 2026-06-17 15:19:17 -07:00
• 03c5448dd8
  Merge pull request #1 from yyj6666667/refactor/minimax-m3 Benjamin 2026-06-17 14:49:16 +08:00
• cc3d9a65bd deploy: 0f2e7905e2 ovowei 2026-06-17 06:26:21 +00:00
• 0f2e7905e2
  Update README.md (#2049) Jianwei Dong 2026-06-17 14:24:23 +08:00
• a4fef71aff
  Update README.md ovowei-patch-3 Jianwei Dong 2026-06-17 14:24:11 +08:00
• 0b4b5145d2 docs(deepseek-v4-flash): pin apache-tvm-ffi<0.1.12 to avoid tilelang TVM FFI clash Tai An 2026-06-16 18:16:15 -07:00
• 4532ebce18 [fix](mxfp8): strict group_size==32 + dim divisibility in derived_init yyj 2026-06-16 23:11:23 +08:00
• 0e2ff783d8
  update glm52 tutorial (#2046) Jianwei Dong 2026-06-16 17:15:23 +08:00
• 542d146e51 glm52 tutorial support-glm52-djw ovowei 2026-06-16 17:03:08 +08:00
• 7641f5445d
  [feat] : Add MACA backend support for kt-kernel and fix CPU MoE tests (#2044) Dayuxiaoshui 2026-06-16 16:49:06 +08:00
• 39f2fc6b9d fix(kt-kernel): delete SyncArgs allocated for cudaLaunchHostFunc callback yyj6666667 2026-06-16 16:46:36 +08:00
• 2dc584084c Fix AMX build flags and CPU MoE tests Dayuxiaoshui 2026-06-16 02:50:09 +00:00
• 93b0d19b1b Add MACA event API mappings Dayuxiaoshui 2026-06-16 01:39:42 +00:00
• 48b628c358 fix(balance_serve): bind scheduler RPC to loopback to close pre-auth pickle RCE sysy 2026-06-15 21:20:05 -04:00
• 54e471796e Add MACA backend support for kt-kernel Dayuxiaoshui 2026-06-15 10:21:36 +00:00
• 66ca4ce22d [fix](amx/mxfp8): unified per-row scatter + uint8 ue8m0 scale write yyj 2026-06-13 16:39:21 +08:00
• 73ddff5c31 fix(avx2/mxfp8): unified per-row scatter for write_weights_to_buffer yyj 2026-06-12 16:20:56 +08:00
• 9496a056a6 fix: add language_model.model prefix for M3 VL expert weight loading yyj 2026-06-06 15:25:12 +08:00
• 1110ef9b0e fix: plumb swiglu_alpha through _create_inference_wrapper for MXFP8 yyj 2026-06-06 14:57:23 +08:00
• bd79ad8840 [feat](kt-kernel): add MXFP8 Python integration (method, loader, wrapper) yyj 2026-06-02 23:07:32 +08:00
• bd71ad3dc7 [feat](kt-kernel): add MXFP8 MoE kernel for MiniMax M3 Preview yyj 2026-06-02 22:50:13 +08:00
• 89d30a3d01
  [fix(loader)]: correct off-by-one expert-count guard in load_experts (#2026) devangpratap 2026-06-07 11:41:04 -04:00
• a8ac75ff36 chore: improve ktransformers maintenance path Noa Levi 2026-06-05 11:36:48 +00:00
• c1cb22311b
  [build]: sync sglang submodule to 51032b71279d9038058563f8d2e758d99b278ef4 (#2032) github-actions[bot] 2026-06-05 19:24:22 +08:00
• 60eb08f8d8 [build]: sync sglang submodule to 51032b71279d9038058563f8d2e758d99b278ef4 ovowei 2026-06-05 09:13:18 +00:00
• a14b6dd5ec deploy: c9a915e6ac jdai0 2026-06-05 08:57:40 +00:00
• c9a915e6ac
  [feat](kt-lora): add end-to-end Qwen3.5 MoE KT LoRA serving workflow (#2031) Jiaheng Dai 2026-06-05 16:57:14 +08:00
• 84837552fa [fix](kt-lora): merge official main djh 2026-06-03 02:54:30 +00:00
• ed11bcf5df [fix](kt-lora): validate adapter conversion djh 2026-06-02 13:12:18 +00:00
• 14191ff407 docs: add trailing newline to FAQ.md Willow Lopez 2026-06-02 02:00:02 +08:00
• 220f16b9de [feat](kt-lora): add merged SGLang adapter workflow djh 2026-06-01 12:06:27 +00:00
• 762c6ebd5c
  Apply suggestion from @gemini-code-assist[bot] Willow Lopez 2026-05-31 20:57:14 +08:00
• 1f6ca08742 docs: add FAQ entry about SGLang MoE kernel config warning Autumn 2026-05-31 13:47:36 +08:00
• 97c033d817 [fix(docker)]: build local kt-kernel in fine-tune env before installing ktransformers devangpratap 2026-05-30 20:23:56 -04:00
• ccbc867ff1 [test(loader)]: import loader as a top-level module in expert-count guard test devangpratap 2026-05-30 20:22:29 -04:00
• e2aa18d8b8 [fix(docker)]: build fine-tune env from source instead of the unpublished release wheel devangpratap 2026-05-30 20:04:13 -04:00
• 6d80523f7c [fix(loader)]: correct off-by-one expert-count guard in SafeTensorLoader.load_experts devangpratap 2026-05-30 18:46:58 -04:00
• 870a628f2b
  Merge 25fa2fd532 into d41f569e84 Pory 2026-05-30 20:18:00 +00:00
• d41f569e84
  [fix](cli): detect SGLANG_DSV4_2604_SUBMODE conflict before launch (#2025) devangpratap 2026-05-30 07:20:47 -04:00
• ef6c47f9d2
  [feat](kt-kernel): AVX2 MXFP4 MoE MXFP4 dispatch (#2015) Benjamin 2026-05-30 19:20:16 +08:00
• 97c5dcac88 feat(mesh): add rolling prefetch + runtime helpers for paper benchmarks RaQiu 2026-05-30 18:45:23 +08:00
• c81cd099d0 Remove unused AMX tile MXFP4 kernel (GemmKernel224MXFP4) yyj 2026-05-30 14:31:00 +08:00
• 08b8ab001e [feat]: pin Qwen3.5 non-expert LoRA support djh 2026-05-27 08:39:31 +00:00
• 230d476fa7 [fix](cli): tighten env-var validation per review feedback devangpratap 2026-05-27 03:07:41 -04:00
• a0fff3c0d4 [fix](cli): detect SGLANG_DSV4_2604_SUBMODE conflict before launch devangpratap 2026-05-27 03:00:52 -04:00
• 072cb350a3 [feat](kt-lora): add KT expert LoRA adapter serving djh 2026-05-26 07:46:08 +00:00