Commit graph

Select branches

Hide pull requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/gosim-2026-and-roadmap-link

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm51-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2015

#220

#224

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

Mono Color

• 69a566831d
  Merge 61ded4f6bc into f0772445a1 login256 2026-05-18 20:45:46 +00:00
• f2658823be
  Merge 3278c92e61 into f0772445a1 Benjamin 2026-05-18 11:01:43 +00:00
• 3278c92e61 [fix](kt-kernel): add intermediate_size parity check in MXFP4 TP flat-buffer path yyj 2026-05-18 18:58:43 +08:00
• 86d18f94db
  Merge 08bdfc22cf into f0772445a1 RaQiu 2026-05-18 17:19:56 +08:00
• f5d44c8611 Merge upstream/main: adopt ActivationBF16/DequantizedWeight non-AVX512BF16 fallback yyj 2026-05-18 16:31:09 +08:00
• 0e3d43adea [fix](kt-kernel): address PR #2010 review — memory leaks, alignment, dynamic expert update yyj 2026-05-18 16:05:41 +08:00
• f0772445a1
  [perf]: native path for MXFP4 MoE on AVX512F (#2006) main Jim James 2026-05-18 02:44:33 -05:00
• 6ca197868a [feat](kt-kernel): AVX2 MXFP4 MoE + AMX tile MXFP4 dispatch yyj 2026-05-17 13:20:06 +00:00
• 08bdfc22cf fix(mesh): chunk prefill scratch promotions RaQiu 2026-05-17 00:56:45 +08:00
• fb1a829e41 fix(mesh): skip score defer during prefill RaQiu 2026-05-17 00:43:39 +08:00
• d7f7e66505 [refactor](mesh): remove mmap residency leftovers RaQiu 2026-05-16 23:43:22 +08:00
• 15ddab0c19 [chore](mesh): move windows and desktop work off main RaQiu 2026-05-16 21:27:37 +08:00
• 778e7affd2 [fix](mesh): clean extracted include endings RaQiu 2026-05-16 21:18:02 +08:00
• 7c9b768475 [refactor](mesh): extract mesh runtime helpers RaQiu 2026-05-16 21:15:32 +08:00
• 744f91e712 [perf]: move inline static constants outside structs Jim James 2026-05-15 03:58:27 -05:00
• 6f4560aefd [perf]: native path for MXFP4 MoE on AVX512F Jim James 2026-05-15 01:23:57 -05:00
• 95e20f9c55
  [build]: sync sglang submodule to ebaff7729b9e41c29d94f8d19a53473d321dc566 (#2005) github-actions[bot] 2026-05-14 22:25:31 +08:00
• d60ddf135e [build]: sync sglang submodule to ebaff7729b9e41c29d94f8d19a53473d321dc566 auto/sync-sglang ovowei 2026-05-14 09:00:00 +00:00
• e23b63259f [feat](mesh): restore prefill expert-window path RaQiu 2026-05-14 10:10:00 +08:00
• b3a21c1476 [feat](mesh): add prefill layer-window residency mode RaQiu 2026-05-13 19:37:53 +08:00
• 61c8c56f1c [fix](mesh): guard resident io by buffer layout RaQiu 2026-05-12 09:56:30 +08:00
• 11ffbebedc [feat](mesh): restore deferred miss instrumentation RaQiu 2026-05-11 23:32:42 +08:00
• 6ff1396bda [chore]: merge upstream main RaQiu 2026-05-11 22:19:46 +08:00
• 3d95b6cb5c [fix](mesh): skip full-gate observe during cuda graph capture RaQiu 2026-05-11 16:01:10 +08:00
• 39894eb7e5 [feat](mesh): implement slot residency and iouring prefetch RaQiu 2026-05-11 15:42:48 +08:00
• f05b4009f3
  [fix](kt-kernel): fix double mem used by safetensor loader (#1997) Benjamin F 2026-05-11 12:00:30 +08:00
• 4a033215bf [fix](kt-kernel): fix double mem used by safetensor loader xiongchenhui 2026-05-10 14:18:45 +08:00
• bb15fdf47e
  Release/0.6.2.post3: carry kt-kernel SwiGLU clamp companion missing from post2 v0.6.2.post3 Benjamin F 2026-05-10 03:55:02 +08:00
• 67abbc8087 [fix](release): 0.6.2.post3 — carry kt-kernel SwiGLU clamp companion missing from post2 yyj 2026-05-09 18:31:25 +00:00
• bd6f4fc18e [feat](v4-2604b): plumb swiglu_limit through MXFP4 CPU MoE path yyj 2026-05-06 20:54:03 +08:00
• a0f9b299bc docs: add entrypoints and support matrix doc-reorg-entrypoints-support-matrix JimmyPeilinLi 2026-05-10 01:22:13 +08:00
• 37db9a3b83
  0.6.2.post2: submodule refactor and update tutorial (#1993) v0.6.2.post2 Benjamin F 2026-05-09 18:53:59 +08:00
• 990812f678 0.6.2.post2: submodule refactor and update tutorial yyj 2026-05-09 18:50:14 +08:00
• f83141512c [release]: 0.6.2.post2 yyj 2026-05-09 17:40:49 +08:00
• 04d3737945 build: bump sglang submodule to 43ed1ec77 (V4-Flash hybrid SWA hang fix + DSV4 plugin refactor) yyj 2026-05-09 17:40:10 +08:00
• 57967bc109 [build]: sync sglang submodule to 43ed1ec77a7fc37e6eeedbf9191e23abd418ae85 ovowei 2026-05-09 08:35:57 +00:00
• f7c4fa68c5
  [fix]: add guard for SFT MoE and remove guard for AMX FP4 MoE on AVX512F+BW (#1980) Jim James 2026-05-08 03:05:22 -05:00
• c465557c23
  docs(v4-flash): add optional AMXINT4 CPU-weight conversion path (#1986) Benjamin F 2026-05-08 15:35:05 +08:00
• c5d9d652c3 docs(v4-flash): add optional AMXINT4 CPU-weight conversion path yyj 2026-05-08 15:27:02 +08:00
• ddea72ed16 [fix]: harden iouring promotion concurrency RaQiu 2026-05-08 11:58:09 +08:00
• dfded881ba [fix]: tolerate safetensors handles without close RaQiu 2026-05-07 23:48:09 +08:00
• cce6b0979f [fix]: align safetensors header without strict payload check RaQiu 2026-05-07 23:45:30 +08:00
• 00a2434310 [fix]: support Qwen3.5 expert key conversion RaQiu 2026-05-07 23:35:51 +08:00
• 4c3d3cf02f [feat]: add safetensors direct I/O aligner RaQiu 2026-05-07 23:28:22 +08:00
• b6d0d292d9 [feat]: complete AMX io_uring resident backend RaQiu 2026-05-07 23:16:06 +08:00
• 61ded4f6bc Fix duplicate BF16 loader definition lyt 2026-05-07 08:02:29 +00:00
• 1bdfaac9a9 [fix]: fallback when cpuinfer stream hooks are unavailable RaQiu 2026-05-07 14:34:38 +08:00
• 1c96c53642 [fix]: skip tiered provider for moe without promotion hooks RaQiu 2026-05-07 14:19:26 +08:00
• 4892595406 [fix]: detect Qwen3.5 unfused BF16 experts RaQiu 2026-05-07 14:09:47 +08:00
• cba709123b [feat]: add residency policy selection for tiered weights RaQiu 2026-05-07 14:03:08 +08:00
• 896de01024 [fix]: accept NUMA nodes in KTMoE wrapper RaQiu 2026-05-07 13:56:52 +08:00
• 5b758e8f1a [feat]: wire AMX io_uring file-slot backend RaQiu 2026-05-07 12:04:17 +08:00
• 5c0b7f2d5e [fix]: add guard for SFT MoE and remove guard for AMX FP4 MoE on AVX512F+BW Jim James 2026-05-06 14:47:57 -05:00
• 99a39728b3 [fix]: io_uring compilation and test fixes RaQiu 2026-05-06 23:44:49 +08:00
• 3740081249 [fix]: AsyncExpertReader constructor signature - remove num_workers parameter RaQiu 2026-05-06 22:10:38 +08:00
• 48b50c8886 [feat]: io_uring Python bindings and CLI integration RaQiu 2026-05-06 21:56:16 +08:00
• 04e1bf132c [feat]: io_uring async I/O for expert weight loading (Sprint 1-2) RaQiu 2026-05-06 17:39:55 +08:00
• 8b9d233d42
  docs(v4-flash): tilelang install, MTP flags, Ampere unsupported (#1979) Benjamin F 2026-05-06 17:29:38 +08:00
• 0207231e8c docs(v4-flash): tilelang install, MTP flags, Ampere unsupported yyj 2026-05-06 15:34:58 +08:00
• 5eeaa13426 [fix](kt-kernel): fix double mem used when loading xiongchenhui 2026-05-06 11:33:16 +08:00
• d7b5b49a3e
  [release]: 0.6.2.post1 v0.6.2.post1 Benjamin F 2026-05-03 21:07:23 +08:00
• dcf5b1c42b release: bump version to 0.6.2.post1 yyj 2026-05-03 21:01:29 +08:00
• 96189972d8
  build: bump sglang submodule to c9edb75e0 (V4-Flash GPU prefill fallback fix + perf) (#1975) Benjamin F 2026-05-03 19:42:19 +08:00
• 3dc081f527 build: bump sglang submodule to c9edb75e0 (V4-Flash GPU prefill fallback fix + perf) yyj 2026-05-03 19:38:09 +08:00
• 088ed979d5
  docs(v4-flash): pin transformers==4.57.1 in tutorial prerequisites (#1974) Benjamin F 2026-05-03 16:07:31 +08:00
• a4ef3ad7f1 docs(v4-flash): pin transformers==4.57.1 in tutorial prerequisites yyj 2026-05-03 16:06:10 +08:00
• 4b4312c0a2
  release: bump version to 0.6.2 (#1973) v0.6.2 Benjamin F 2026-05-03 14:28:09 +08:00
• f2ce7d061a release: bump version to 0.6.2 yyj 2026-05-03 14:10:46 +08:00
• bb3b6e8413
  build: bump sglang submodule to 40d3a82 (V4-Flash flashinfer guard) (#1972) Benjamin F 2026-05-03 14:06:33 +08:00
• 11c0667027 build: bump sglang submodule to 40d3a82 (V4-Flash flashinfer guard) yyj 2026-05-03 13:15:09 +08:00
• 53f356c328 deploy: 041bdfc636 gh-pages yyj6666667 2026-05-03 02:48:51 +00:00
• 041bdfc636
  [New Model] DeepSeek-V4-Flash: kt-kernel MXFP4 MoE + sglang hybrid inference (#1970) Benjamin F 2026-05-03 10:48:31 +08:00
• 667107996d docs(v4-flash): hybrid CPU/GPU recipe + bump kt-sglang submodule yyj 2026-05-02 21:46:53 +08:00
• 1f197e3540 fix(loader): avoid uint16 lshift in ue8m0->bf16 conversion yyj 2026-04-26 18:52:27 +08:00
• d50c09eea5 [perf](kt-kernel): MXFP4 MoE add mat-mat 4×4 tile, refine mat-vec reduce (#1957) Benjamin F 2026-04-26 17:34:08 +08:00
• 5c2593901d [feat](kt-kernel): adapt MXFP4 MoE backend for DeepSeek-V4-Flash (#1950) Benjamin F 2026-04-25 18:11:53 +08:00
• 6f5b413750 [feat](kt-kernel): add MXFP4 MoE operator with E2M1 weights × BF16 activations ouqingliang 2026-04-21 02:53:04 +00:00
• fe06c4d355
  [build]: sync sglang submodule to 537eb762b0881071a0e098bd78666fe052b83deb (#1967) github-actions[bot] 2026-05-02 12:42:04 +08:00
• 9ccc262ab2 [build]: sync sglang submodule to 537eb762b0881071a0e098bd78666fe052b83deb ovowei 2026-05-01 08:43:28 +00:00
• fb4e11db95 deploy: 02be2bf53f jdai0 2026-04-30 09:17:11 +00:00
• 02be2bf53f
  [feat](kt-kernel): add AVX2/AVX-VNNI RAWINT4 MoE backend (#1942) Aliez Ren 2026-04-30 18:16:49 +09:00
• 7b5c87d07e
  Add instructions for AVX2 compilation Jiaheng Dai 2026-04-30 17:00:15 +08:00
• b91a54e185
  Update AVX2 tutorial with AVX2 compilation instructions Jiaheng Dai 2026-04-30 16:58:46 +08:00
• c449365810 [fix](kt-kernel): fix double mem used by safetensor loader xiongchenhui 2026-04-30 16:27:27 +08:00
• 07f39626ae deploy: 8c634d5dca JimmyPeilinLi 2026-04-30 08:25:52 +00:00
• 8c634d5dca
  [docs]: refresh kt inference and sft entry points Peilin Li 2026-04-30 16:25:34 +08:00
• dbc254a0f5 [docs]: refresh kt inference and sft entry points JimmyPeilinLi 2026-04-30 08:23:48 +00:00
• 24b1941b85
  [fix]: point sglang extra to post2 (#1964) v0.6.1 Peilin Li 2026-04-30 11:57:02 +08:00
• 5928ccb0b5 [fix]: point sglang extra to post2 JimmyPeilinLi 2026-04-30 03:16:05 +00:00
• 72044ad65f
  [build]: bump v0.6.1 post1 package metadata v0.6.1.post1 Peilin Li 2026-04-30 01:02:44 +08:00
• 429b83f57a [build]: bump v0.6.1 post1 package metadata JimmyPeilinLi 2026-04-29 17:01:37 +00:00
• ef5822639f
  [fix](kt-kernel): pin torch 2.9.1 wheel baseline Peilin Li 2026-04-30 00:57:24 +08:00
• 719fa0a06d [build](sglang): bump submodule for torch 2.9.1 baseline JimmyPeilinLi 2026-04-29 16:07:42 +00:00
• 65c04c4c55 [fix](kt-kernel): pin torch 2.9.1 wheel baseline JimmyPeilinLi 2026-04-29 16:07:00 +00:00
• 9f34ef46e6
  [fix](Qwen3 series): fix gibberish output by correcting RoPE write-back (#31) (#1959) Benjamin F 2026-04-27 22:04:29 +08:00
• 1cb73c7100 [fix](Qwen3 series): fix gibberish output by correcting RoPE write-back (#31) bump-sglang-pr31 yyj 2026-04-27 21:59:38 +08:00
• 6fea6b7d99 deploy: 0656e01ac1 JimmyPeilinLi 2026-04-26 16:46:01 +00:00
• 0656e01ac1
  [docs]: refresh KT install commands (#1958) Peilin Li 2026-04-27 00:45:43 +08:00
• d93ea7e21e [docs]: refresh KT install commands docs-v061-refresh JimmyPeilinLi 2026-04-26 16:29:20 +00:00
• a7a575d41e
  [perf](kt-kernel): MXFP4 MoE add mat-mat 4×4 tile, refine mat-vec reduce (#1957) fp4-moe-amx Benjamin F 2026-04-26 17:34:08 +08:00