Commit graph

Select branches

Hide pull requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#220

#224

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

Mono Color

• 5eaa726cd9 release: publish verified existing-project wheels release/0.7.0.post2-frozen-pypi yyj 2026-08-27 08:14:30 +08:00
• a67a1de936 chore(release): pin complete carrier runtime hotfix/0.7.0.post2-pypi-runtime yyj 2026-08-27 07:43:14 +08:00
• cf1a9b9017 chore(release): pin complete carrier runtime yyj 2026-08-27 07:43:14 +08:00
• a33041a82f fix(release): use existing PyPI carriers for SGL runtime yyj 2026-08-27 07:33:03 +08:00
• eb61e80cb2 fix(release): use existing PyPI carriers for SGL runtime yyj 2026-08-27 07:33:03 +08:00
• 29140e9866 ci(release): publish verified carrier wheels yyj 2026-08-27 07:20:53 +08:00
• 205af62fc8 chore(release): pin carrier-wheel runtime yyj 2026-08-27 07:19:24 +08:00
• 7f61f0091f ci(release): resume verified PyPI uploads safely yyj 2026-08-27 06:28:33 +08:00
• 8c24b9577c chore(release): pin manylinux payload runtime yyj 2026-08-27 06:23:20 +08:00
• 981fb96fd6 ci(release): publish verified manylinux wheels yyj 2026-08-27 06:23:00 +08:00
• ad8e156f51 ci(release): expose PyPI upload diagnostics yyj 2026-08-27 06:09:38 +08:00
• 06f42ea8e3 chore(release): pin split CUDA payload runtime yyj 2026-08-27 06:06:36 +08:00
• 89d290fa50 ci(release): publish verified split CUDA payloads yyj 2026-08-27 06:06:14 +08:00
• 2ad8a777d3 ci(release): publish verified KT kernel distribution yyj 2026-08-27 05:31:10 +08:00
• 48c3f79076 chore(release): update SGL kernel distribution compatibility yyj 2026-08-27 05:05:47 +08:00
• 406771d1f9 fix(release): correct sglang hotfix gitlink yyj 2026-08-27 04:55:46 +08:00
• dcafbfb6e1 chore(release): point to KT-owned SGL kernel package yyj 2026-08-27 04:54:38 +08:00
• 39977ce6f1 ci(release): publish frozen post2 wheels yyj 2026-08-27 04:49:47 +08:00
• 469ffc625a chore(release): update sglang-kt runtime hotfix yyj 2026-08-27 03:33:10 +08:00
• 458cdcd5ba fix(packaging): reuse validated kt-kernel post1 wheels yyj 2026-08-27 01:05:53 +08:00
• ba1939d74e fix(release): prepare 0.7.0.post2 runtime hotfix yyj 2026-08-27 01:01:44 +08:00
• b18ea27588 deploy: 41613064c7 gh-pages yyj6666667 2026-08-26 14:45:32 +00:00
• 41613064c7
  feat(GLM): add native GLM-5.3-flash support (#2173) main v0.7.0.post1 yyj 2026-08-26 22:45:12 +08:00
• 675328dfad [build]: sync sglang submodule to bc7f0058fafe6c05dc6ad52d6b1c854af2a673b2 auto/sync-sglang ovowei 2026-08-25 08:56:31 +00:00
• 96be9f560b deploy: c40d37c63c JimmyPeilinLi 2026-08-24 18:46:32 +00:00
• e70e6e86c8 deploy: 62d7b69e75 JimmyPeilinLi 2026-08-24 18:45:08 +00:00
• 978f29d2a1 deploy: 902ab98d46 JimmyPeilinLi 2026-08-24 18:44:14 +00:00
• 14c69a6f07 deploy: c40d37c63c JimmyPeilinLi 2026-08-24 18:39:59 +00:00
• 93219c3b9a deploy: 62d7b69e75 JimmyPeilinLi 2026-08-24 18:22:23 +00:00
• 6c1e32e12d deploy: 902ab98d46 JimmyPeilinLi 2026-08-24 18:20:30 +00:00
• 7f93f91c80 deploy: 62d7b69e75 JimmyPeilinLi 2026-08-24 18:19:59 +00:00
• 17586cb966 deploy: 902ab98d46 JimmyPeilinLi 2026-08-24 18:11:41 +00:00
• c40d37c63c
  docs: add fine-tuning milestones to README updates (#2171) Peilin Li 2026-08-25 01:48:41 +08:00
• 62d7b69e75
  [docs]: add English fine-tuning cookbook (#2170) Peilin Li 2026-08-25 01:35:14 +08:00
• 902ab98d46
  [docs]: add easy-to-use fine-tuning cookbook (#2169) Peilin Li 2026-08-25 01:13:41 +08:00
• 95009ea685
  Add MiniMax-M3 and MiniMax-M2.7 to the kt-cli model registry (#2112) Octopus 2026-08-21 17:53:58 +08:00
• 41e54fd44c
  [docs]: use official LlamaFactory repository in VLM guide (#2165) liyuemathematician 2026-08-18 20:10:50 +08:00
• 517e7a4368
  fix(build): keep AVX2 wheel free of AVX512 flags (#2164) yyj 2026-08-18 17:28:00 +08:00
• 497ad7b5df fix(build): keep AVX2 wheel free of AVX512 flags fix/avx2-wheel-feature-isolation yyj 2026-08-18 17:26:13 +08:00
• d406efc848
  ci: run release jobs on self-hosted runner (#2163) yyj 2026-08-18 17:15:40 +08:00
• 25402bb66b ci: run release jobs on self-hosted runner fix/release-self-hosted-runner yyj 2026-08-18 17:14:31 +08:00
• ea81f4e9e5
  ci: automate coordinated KT PyPI releases (#2162) yyj 2026-08-18 17:09:59 +08:00
• a05e5165ba ci: automate coordinated KT PyPI releases release/automate-kt-sft-pypi yyj 2026-08-18 17:06:07 +08:00
• d28b0c2eca deploy: e80614fc2d yyj6666667 2026-08-17 08:33:06 +00:00
• e80614fc2d
  [feat](kt-sft): Activation reuse & Int8 kernel refactor & native block-FP8 LoRA SFT (#2141) v0.7.0 yyj 2026-08-17 16:25:14 +08:00
• 168f581676
  [feat](sft): support Qwen VLM MoE fine-tuning (#2156) liyuemathematician 2026-08-17 10:51:55 +08:00
• 52b46826d4
  Delete kt-kernel/test/test_swiglu_limit_method_guards.py support-glm5-next-djw yyj 2026-08-15 22:00:55 +08:00
• 7b1cd66475 feat: support SwiGLU limit for block FP8 experts yyj 2026-08-12 03:13:13 +08:00
• eb9b70c411
  [build]: sync sglang submodule (#2069) github-actions[bot] 2026-08-08 18:45:46 +08:00
• f5ee50d4cf
  [docs] dsv4 tutorial update(#2140) yyj 2026-08-05 18:01:01 +08:00
• e03cf1cefe
  docs: add DeepSeek V4 Flash Docker guide (#2136) yyj 2026-08-05 00:11:27 +08:00
• 4514fa461c docs: add DeepSeek V4 Flash Docker guide docs/deepseek-v4-flash-docker yyj 2026-08-04 17:23:58 +08:00
• 1a14f473cc
  [build] Sync sglang-kt submodule #2117 yyj 2026-08-02 20:11:37 +08:00
• a8062bfa7e
  release: bump version to 0.6.4 (#2105) yyj 2026-07-23 22:42:28 +08:00
• 924754a00b
  [feat](kt-kernel): end-to-end full-parameter and LoRA SFT(#2094) v0.6.4 yyj 2026-07-23 21:23:34 +08:00
• d1a3ed8a30
  [perf]: add K2 RAWINT4 prefill mat-mat dispatch (#2080) yyj 2026-07-19 21:43:01 +08:00
• 937f61c988
  [fix](kt-kernel): AVX-VNNI-256 RAWINT4 per-expert weight loading (#2092) Aaryan Mehta 2026-07-19 05:24:52 -04:00
• def0f9313d
  fix(security): bind balance_serve scheduler ZMQ socket to loopback (#2087) (#2091) Tai An 2026-07-18 20:38:22 -07:00
• 821f3b6198 deploy: 0c2912a5e2 yyj6666667 2026-07-17 08:24:56 +00:00
• 0c2912a5e2
  [feat] Add SYCL backend for intel iGPU (#2089) callmegaga 2026-07-17 16:24:04 +08:00
• 01fdfa609e
  docs(DSV4): add supplementary deployment and tuning notes Graham 2026-07-15 00:06:58 -05:00
• ef590428a1 deploy: 7c021b430c yyj6666667 2026-07-10 03:21:48 +00:00
• 7c021b430c
  [chore](sglang): bump sglang submodule for FP16 FE8M0 Marlin fix (#2082) callmegaga 2026-07-10 11:18:45 +08:00
• cb9f47d142
  [fix](cli): detect bound ports before launch (#2071) VectorPeak 2026-07-06 18:25:31 +08:00
• 79b265b2f6
  fix: normalize compressed RAWINT4 weights (#2075) lutianshu824 2026-07-06 18:06:52 +08:00
• d076e63b25
  Merge b1b2174a87 into 8e46e5896c Shaurya Omar 2026-06-25 20:38:30 +00:00
• b1b2174a87 feat(kt-kernel): add score-aware expert placement Shaurya Omar 2026-06-26 01:39:42 +05:30
• 8e46e5896c
  release: bump version to 0.6.3.post1 (#2063) v0.6.3.post1 Benjamin 2026-06-25 22:42:55 +08:00
• 99cf022b0a release: bump version to 0.6.3.post1 yyj 2026-06-25 22:38:00 +08:00
• 93078f8231 ci(release-pypi): set up Python in publish-pypi job (fixes PEP 668) yyj 2026-06-25 22:18:05 +08:00
• 0e73671b18
  Merge 97c033d817 into 459df61262 devangpratap 2026-06-25 12:46:29 +00:00
• 531cbcbf39
  Merge 48b628c358 into 459df61262 sysy 2026-06-25 12:46:28 +00:00
• 459df61262
  [build] Sync sglang-kt submodule (v0.6.3) (#2055) github-actions[bot] 2026-06-25 20:41:04 +08:00
• 4317bff7f8 ci(release-pypi): target manylinux_2_35 (build host glibc), drop dishonest fallback yyj 2026-06-25 20:31:53 +08:00
• f8fd344610 ci(release-pypi): verify wheel inside $RUNNER_TEMP, not /tmp yyj 2026-06-25 16:59:32 +08:00
• c02eac80a9 ci(release-pypi): skip apt-get on self-hosted runners; split pip indexes yyj 2026-06-25 15:59:15 +08:00
• a5764116c5 Merge remote-tracking branch 'upstream/main' into push-to-pr-2055 yyj 2026-06-25 20:37:26 +08:00
• a0c7431187
  ci(release-pypi): make release pipeline self-consistent (#2062) Benjamin 2026-06-25 20:05:06 +08:00
• 59f028ff80 [build]: sync sglang submodule to 5d6bef9f61637aaeaf047bf8209def2af3eaa83f ovowei 2026-06-25 09:11:05 +00:00
• 42fb35eb7a ci(release-pypi): make release pipeline self-consistent and Blackwell-ready yyj 2026-06-25 15:24:03 +08:00
• 808b549c16 deploy: 983a88b620 yyj6666667 2026-06-24 07:23:06 +00:00
• 7c752ebd30 deploy: 08d70e8605 yyj6666667 2026-06-24 07:22:49 +00:00
• ecdeeb9923 deploy: 983a88b620 yyj6666667 2026-06-24 07:14:42 +00:00
• 983a88b620
  docs: add FAQ entry about SGLang MoE kernel config warning (#2029) Willow Lopez 2026-06-24 15:12:54 +08:00
• 8db3561516
  Update GPU architecture support information Benjamin 2026-06-24 15:12:21 +08:00
• 08d70e8605
  [fix](kt-kernel): enable -mavx512vl for AVX512_VBMI/BF16 multi-variant builds (#2021) Hermann Hans Klie 2026-06-24 09:05:36 +02:00
• 7dffc947e5
  Clean up AVX512 flags section in CMakeLists.txt Benjamin 2026-06-24 15:04:56 +08:00
• 0a7785423a [fix](security): HMAC-authenticate scheduler RPC to prevent pickle deserialization RCE devangpratap 2026-06-23 17:55:56 -04:00
• 9924c9f1bb deploy: 1ed332b6ea jdai0 2026-06-23 12:52:37 +00:00
• 1ed332b6ea
  [docs]: clean up Qwen3.5 KT LoRA serving guide (#2057) Jiaheng Dai 2026-06-23 20:52:23 +08:00
• 4e10cb4a7c
  Update doc/zh/Qwen3.5-SGLang-LoRA-Serving_zh.md Jiaheng Dai 2026-06-23 20:44:52 +08:00
• d46d5b65b8 [docs]: clean up Qwen3.5 KT LoRA serving guide djh 2026-06-23 12:40:47 +00:00
• 19fc69d597 deploy: c884dbd221 yyj6666667 2026-06-21 09:55:38 +00:00
• c884dbd221
  release: bump version to 0.6.3 (#2054) Benjamin 2026-06-21 17:55:24 +08:00
• e03c014465 release: bump version to 0.6.3 yyj 2026-06-21 17:51:25 +08:00
• ce7c3ddbe9
  [build]: sync sglang submodule to 8b636f9008dbad58c0a8e481b03e794739e6c146 (#2047) v0.6.3 github-actions[bot] 2026-06-21 17:37:52 +08:00
• 597e051a6d [build]: sync sglang submodule to 8b636f9008dbad58c0a8e481b03e794739e6c146 ovowei 2026-06-21 09:19:09 +00:00
• 6c9c95601d
  [fix](kt-kernel): CudaGraph replay fix and Add MoE startup log (#2037) Benjamin 2026-06-18 17:15:37 +08:00
• 3ffa8871aa fix(kt-kernel/cpuinfer): drop delete args — UAF under CUDA Graph replay yyj 2026-06-18 16:41:30 +08:00
• f95dd3f0d2 [fix](kt-kernel): clarify AMX vs AVX512-BF16 backend in MoE startup log yyj 2026-06-09 13:19:45 +08:00