Commit graph

Select branches

Hide pull requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#220

#224

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

Mono Color

• 96be9f560b deploy: c40d37c63c gh-pages JimmyPeilinLi 2026-08-24 18:46:32 +00:00
• e70e6e86c8 deploy: 62d7b69e75 JimmyPeilinLi 2026-08-24 18:45:08 +00:00
• 978f29d2a1 deploy: 902ab98d46 JimmyPeilinLi 2026-08-24 18:44:14 +00:00
• 14c69a6f07 deploy: c40d37c63c JimmyPeilinLi 2026-08-24 18:39:59 +00:00
• 93219c3b9a deploy: 62d7b69e75 JimmyPeilinLi 2026-08-24 18:22:23 +00:00
• 6c1e32e12d deploy: 902ab98d46 JimmyPeilinLi 2026-08-24 18:20:30 +00:00
• 7f93f91c80 deploy: 62d7b69e75 JimmyPeilinLi 2026-08-24 18:19:59 +00:00
• 17586cb966 deploy: 902ab98d46 JimmyPeilinLi 2026-08-24 18:11:41 +00:00
• c40d37c63c
  docs: add fine-tuning milestones to README updates (#2171) main Peilin Li 2026-08-25 01:48:41 +08:00
• 62d7b69e75
  [docs]: add English fine-tuning cookbook (#2170) Peilin Li 2026-08-25 01:35:14 +08:00
• 902ab98d46
  [docs]: add easy-to-use fine-tuning cookbook (#2169) Peilin Li 2026-08-25 01:13:41 +08:00
• 8f56f98f86 [build]: sync sglang submodule to bc7f0058fafe6c05dc6ad52d6b1c854af2a673b2 auto/sync-sglang ovowei 2026-08-22 08:07:41 +00:00
• 95009ea685
  Add MiniMax-M3 and MiniMax-M2.7 to the kt-cli model registry (#2112) Octopus 2026-08-21 17:53:58 +08:00
• 41e54fd44c
  [docs]: use official LlamaFactory repository in VLM guide (#2165) liyuemathematician 2026-08-18 20:10:50 +08:00
• 517e7a4368
  fix(build): keep AVX2 wheel free of AVX512 flags (#2164) yyj 2026-08-18 17:28:00 +08:00
• 497ad7b5df fix(build): keep AVX2 wheel free of AVX512 flags fix/avx2-wheel-feature-isolation yyj 2026-08-18 17:26:13 +08:00
• d406efc848
  ci: run release jobs on self-hosted runner (#2163) yyj 2026-08-18 17:15:40 +08:00
• 25402bb66b ci: run release jobs on self-hosted runner fix/release-self-hosted-runner yyj 2026-08-18 17:14:31 +08:00
• ea81f4e9e5
  ci: automate coordinated KT PyPI releases (#2162) yyj 2026-08-18 17:09:59 +08:00
• a05e5165ba ci: automate coordinated KT PyPI releases release/automate-kt-sft-pypi yyj 2026-08-18 17:06:07 +08:00
• d28b0c2eca deploy: e80614fc2d yyj6666667 2026-08-17 08:33:06 +00:00
• e80614fc2d
  [feat](kt-sft): Activation reuse & Int8 kernel refactor & native block-FP8 LoRA SFT (#2141) v0.7.0 yyj 2026-08-17 16:25:14 +08:00
• 168f581676
  [feat](sft): support Qwen VLM MoE fine-tuning (#2156) liyuemathematician 2026-08-17 10:51:55 +08:00
• 52b46826d4
  Delete kt-kernel/test/test_swiglu_limit_method_guards.py support-glm5-next-djw yyj 2026-08-15 22:00:55 +08:00
• 7b1cd66475 feat: support SwiGLU limit for block FP8 experts yyj 2026-08-12 03:13:13 +08:00
• eb9b70c411
  [build]: sync sglang submodule (#2069) github-actions[bot] 2026-08-08 18:45:46 +08:00
• f5ee50d4cf
  [docs] dsv4 tutorial update(#2140) yyj 2026-08-05 18:01:01 +08:00
• e03cf1cefe
  docs: add DeepSeek V4 Flash Docker guide (#2136) yyj 2026-08-05 00:11:27 +08:00
• 4514fa461c docs: add DeepSeek V4 Flash Docker guide docs/deepseek-v4-flash-docker yyj 2026-08-04 17:23:58 +08:00
• 1a14f473cc
  [build] Sync sglang-kt submodule #2117 yyj 2026-08-02 20:11:37 +08:00
• a8062bfa7e
  release: bump version to 0.6.4 (#2105) yyj 2026-07-23 22:42:28 +08:00
• 924754a00b
  [feat](kt-kernel): end-to-end full-parameter and LoRA SFT(#2094) v0.6.4 yyj 2026-07-23 21:23:34 +08:00
• d1a3ed8a30
  [perf]: add K2 RAWINT4 prefill mat-mat dispatch (#2080) yyj 2026-07-19 21:43:01 +08:00
• 937f61c988
  [fix](kt-kernel): AVX-VNNI-256 RAWINT4 per-expert weight loading (#2092) Aaryan Mehta 2026-07-19 05:24:52 -04:00
• def0f9313d
  fix(security): bind balance_serve scheduler ZMQ socket to loopback (#2087) (#2091) Tai An 2026-07-18 20:38:22 -07:00
• 821f3b6198 deploy: 0c2912a5e2 yyj6666667 2026-07-17 08:24:56 +00:00
• 0c2912a5e2
  [feat] Add SYCL backend for intel iGPU (#2089) callmegaga 2026-07-17 16:24:04 +08:00
• 01fdfa609e
  docs(DSV4): add supplementary deployment and tuning notes Graham 2026-07-15 00:06:58 -05:00
• ef590428a1 deploy: 7c021b430c yyj6666667 2026-07-10 03:21:48 +00:00
• 7c021b430c
  [chore](sglang): bump sglang submodule for FP16 FE8M0 Marlin fix (#2082) callmegaga 2026-07-10 11:18:45 +08:00
• cb9f47d142
  [fix](cli): detect bound ports before launch (#2071) VectorPeak 2026-07-06 18:25:31 +08:00
• 79b265b2f6
  fix: normalize compressed RAWINT4 weights (#2075) lutianshu824 2026-07-06 18:06:52 +08:00
• d076e63b25
  Merge b1b2174a87 into 8e46e5896c Shaurya Omar 2026-06-25 20:38:30 +00:00
• b1b2174a87 feat(kt-kernel): add score-aware expert placement Shaurya Omar 2026-06-26 01:39:42 +05:30
• 8e46e5896c
  release: bump version to 0.6.3.post1 (#2063) v0.6.3.post1 Benjamin 2026-06-25 22:42:55 +08:00
• 99cf022b0a release: bump version to 0.6.3.post1 yyj 2026-06-25 22:38:00 +08:00
• 93078f8231 ci(release-pypi): set up Python in publish-pypi job (fixes PEP 668) yyj 2026-06-25 22:18:05 +08:00
• 0e73671b18
  Merge 97c033d817 into 459df61262 devangpratap 2026-06-25 12:46:29 +00:00
• 531cbcbf39
  Merge 48b628c358 into 459df61262 sysy 2026-06-25 12:46:28 +00:00
• 459df61262
  [build] Sync sglang-kt submodule (v0.6.3) (#2055) github-actions[bot] 2026-06-25 20:41:04 +08:00
• 4317bff7f8 ci(release-pypi): target manylinux_2_35 (build host glibc), drop dishonest fallback yyj 2026-06-25 20:31:53 +08:00
• f8fd344610 ci(release-pypi): verify wheel inside $RUNNER_TEMP, not /tmp yyj 2026-06-25 16:59:32 +08:00
• c02eac80a9 ci(release-pypi): skip apt-get on self-hosted runners; split pip indexes yyj 2026-06-25 15:59:15 +08:00
• a5764116c5 Merge remote-tracking branch 'upstream/main' into push-to-pr-2055 yyj 2026-06-25 20:37:26 +08:00
• a0c7431187
  ci(release-pypi): make release pipeline self-consistent (#2062) Benjamin 2026-06-25 20:05:06 +08:00
• 59f028ff80 [build]: sync sglang submodule to 5d6bef9f61637aaeaf047bf8209def2af3eaa83f ovowei 2026-06-25 09:11:05 +00:00
• 42fb35eb7a ci(release-pypi): make release pipeline self-consistent and Blackwell-ready yyj 2026-06-25 15:24:03 +08:00
• 808b549c16 deploy: 983a88b620 yyj6666667 2026-06-24 07:23:06 +00:00
• 7c752ebd30 deploy: 08d70e8605 yyj6666667 2026-06-24 07:22:49 +00:00
• ecdeeb9923 deploy: 983a88b620 yyj6666667 2026-06-24 07:14:42 +00:00
• 983a88b620
  docs: add FAQ entry about SGLang MoE kernel config warning (#2029) Willow Lopez 2026-06-24 15:12:54 +08:00
• 8db3561516
  Update GPU architecture support information Benjamin 2026-06-24 15:12:21 +08:00
• 08d70e8605
  [fix](kt-kernel): enable -mavx512vl for AVX512_VBMI/BF16 multi-variant builds (#2021) Hermann Hans Klie 2026-06-24 09:05:36 +02:00
• 7dffc947e5
  Clean up AVX512 flags section in CMakeLists.txt Benjamin 2026-06-24 15:04:56 +08:00
• 0a7785423a [fix](security): HMAC-authenticate scheduler RPC to prevent pickle deserialization RCE devangpratap 2026-06-23 17:55:56 -04:00
• 9924c9f1bb deploy: 1ed332b6ea jdai0 2026-06-23 12:52:37 +00:00
• 1ed332b6ea
  [docs]: clean up Qwen3.5 KT LoRA serving guide (#2057) Jiaheng Dai 2026-06-23 20:52:23 +08:00
• 4e10cb4a7c
  Update doc/zh/Qwen3.5-SGLang-LoRA-Serving_zh.md Jiaheng Dai 2026-06-23 20:44:52 +08:00
• d46d5b65b8 [docs]: clean up Qwen3.5 KT LoRA serving guide djh 2026-06-23 12:40:47 +00:00
• 19fc69d597 deploy: c884dbd221 yyj6666667 2026-06-21 09:55:38 +00:00
• c884dbd221
  release: bump version to 0.6.3 (#2054) Benjamin 2026-06-21 17:55:24 +08:00
• e03c014465 release: bump version to 0.6.3 yyj 2026-06-21 17:51:25 +08:00
• ce7c3ddbe9
  [build]: sync sglang submodule to 8b636f9008dbad58c0a8e481b03e794739e6c146 (#2047) v0.6.3 github-actions[bot] 2026-06-21 17:37:52 +08:00
• 597e051a6d [build]: sync sglang submodule to 8b636f9008dbad58c0a8e481b03e794739e6c146 ovowei 2026-06-21 09:19:09 +00:00
• 6c9c95601d
  [fix](kt-kernel): CudaGraph replay fix and Add MoE startup log (#2037) Benjamin 2026-06-18 17:15:37 +08:00
• 3ffa8871aa fix(kt-kernel/cpuinfer): drop delete args — UAF under CUDA Graph replay yyj 2026-06-18 16:41:30 +08:00
• f95dd3f0d2 [fix](kt-kernel): clarify AMX vs AVX512-BF16 backend in MoE startup log yyj 2026-06-09 13:19:45 +08:00
• 73d611fe2a revert(kt-kernel/cpuinfer): drop delete args from sync_ callback yyj 2026-06-18 16:32:20 +08:00
• 943cc4daeb
  [feat] MXFP8 MoE support (#2041) Benjamin 2026-06-18 16:18:49 +08:00
• a50a505408 refactor(avx2/mxfp8): wire backend + swigluoai activation yyj 2026-06-18 15:21:00 +08:00
• 21d5b40323
  docs(deepseek-v4-flash): pin apache-tvm-ffi<0.1.12 to avoid tilelang TVM FFI registration clash (#2045) (#2048) Tai An 2026-06-17 20:10:56 -07:00
• 50d9434800
  [docs](kt-kernel): add MiniMax-M3 SGLang + KT-Kernel tutorial (#2051) Benjamin 2026-06-18 10:40:51 +08:00
• 3b02827282 [docs](kt-kernel): add MiniMax-M3 SGLang + KT-Kernel tutorial yyj 2026-06-18 10:36:47 +08:00
• ee0274e63b docs(deepseek-v4-flash): move apache-tvm-ffi pin rationale into a Note blockquote Tai An 2026-06-17 15:19:17 -07:00
• 03c5448dd8
  Merge pull request #1 from yyj6666667/refactor/minimax-m3 Benjamin 2026-06-17 14:49:16 +08:00
• cc3d9a65bd deploy: 0f2e7905e2 ovowei 2026-06-17 06:26:21 +00:00
• 0f2e7905e2
  Update README.md (#2049) Jianwei Dong 2026-06-17 14:24:23 +08:00
• a4fef71aff
  Update README.md ovowei-patch-3 Jianwei Dong 2026-06-17 14:24:11 +08:00
• 0b4b5145d2 docs(deepseek-v4-flash): pin apache-tvm-ffi<0.1.12 to avoid tilelang TVM FFI clash Tai An 2026-06-16 18:16:15 -07:00
• 4532ebce18 [fix](mxfp8): strict group_size==32 + dim divisibility in derived_init yyj 2026-06-16 23:11:23 +08:00
• 0e2ff783d8
  update glm52 tutorial (#2046) Jianwei Dong 2026-06-16 17:15:23 +08:00
• 542d146e51 glm52 tutorial support-glm52-djw ovowei 2026-06-16 17:03:08 +08:00
• 7641f5445d
  [feat] : Add MACA backend support for kt-kernel and fix CPU MoE tests (#2044) Dayuxiaoshui 2026-06-16 16:49:06 +08:00
• 39f2fc6b9d fix(kt-kernel): delete SyncArgs allocated for cudaLaunchHostFunc callback yyj6666667 2026-06-16 16:46:36 +08:00
• 2dc584084c Fix AMX build flags and CPU MoE tests Dayuxiaoshui 2026-06-16 02:50:09 +00:00
• 93b0d19b1b Add MACA event API mappings Dayuxiaoshui 2026-06-16 01:39:42 +00:00
• 48b628c358 fix(balance_serve): bind scheduler RPC to loopback to close pre-auth pickle RCE sysy 2026-06-15 21:20:05 -04:00
• 54e471796e Add MACA backend support for kt-kernel Dayuxiaoshui 2026-06-15 10:21:36 +00:00
• 66ca4ce22d [fix](amx/mxfp8): unified per-row scatter + uint8 ue8m0 scale write yyj 2026-06-13 16:39:21 +08:00
• 73ddff5c31 fix(avx2/mxfp8): unified per-row scatter for write_weights_to_buffer yyj 2026-06-12 16:20:56 +08:00