Commit graph

Select branches

Hide pull requests

Atream-patch-1

Atream-patch-2

Atream-patch-3

Atream-patch-4

Atream-patch-5

UnicornChan-patch-1

Update-WeChatGroup

add_query_cancel

change-yaml

develop-0.2.4

feat-update-package

fix-flashinfer-precision-zbx

fix-workspace-buffer

gh-pages

hyc

load-DeepSeek-0528

main

make-kv_b_proj-contiguous

mmlu_test_03

pr-1247

prefix-cache

qiyuxinlin-patch-1

qiyuxinlin-patch-2

qiyuxinlin-patch-3

sosp25-ae

support-glm4

support-kimi-k2

support-llama4

support-npu

support-smt-glm4

support_load_safetensor

tmp-main

update-default-config

update-installation-guide

update-readme

update-readme-djw

v0.3.2

work-action

wx-csy-patch-1

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1245

#1246

#1247

#126

#1266

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1422

#1428

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1449

#1452

#1452

#1456

#1457

#1457

#1458

#1458

#1466

#1487

#1487

#151

#152

#153

#158

#160

#163

#165

#166

#17

#170

#178

#18

#180

#183

#189

#190

#2

#200

#220

#224

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

Mono Color

• 3487f874d9
  Merge e265f35c06 into ee2ede0412 LZWuuu 2025-08-29 06:59:37 +00:00
• e265f35c06 Add Hunyuan Suppprt Readme File LZWuuu 2025-08-29 06:50:59 +00:00
• 6870be5180 Add support for Hunyuan model LZWuuu 2025-08-28 08:49:11 +00:00
• 8423eca755
  Merge 7bee717919 into ee2ede0412 jiafei96 2025-08-28 08:12:57 +00:00
• 7bee717919 fix rocm build error jiafei96 2025-07-22 06:13:08 +00:00
• 4f4d7d3696
  Merge 206e51f77e into ee2ede0412 Natsu 2025-08-09 13:15:04 +00:00
• 206e51f77e fix build failure on msvc akemimadoka 2025-04-30 21:51:49 +08:00
• 57aa333f38
  Merge a6ab9e349c into ee2ede0412 jiafei96 2025-08-09 23:19:02 +12:00
• 3aa2e96941
  Merge 0dce748549 into ee2ede0412 zydxt 2025-08-09 17:50:10 +08:00
• e204a0bb6b
  Merge 8c8cb207aa into ee2ede0412 Jesse 2025-08-05 15:24:17 +08:00
• efe4d7b2bc
  Merge 4890f18605 into ee2ede0412 Bruce 2025-08-05 11:05:50 +08:00
• 90d6b5f866
  Merge a289d3f598 into ee2ede0412 Johnny 2025-08-03 19:41:11 +08:00
• e021c4ee66 sosp25-ae ready sosp25-ae chenht2022 2025-08-01 13:43:44 +00:00
• d3ccb43a91
  Merge 67657916a3 into ee2ede0412 R0CKSTAR 2025-07-31 11:20:22 +08:00
• 276ff619f9
  Merge 34cd6c5b3b into ee2ede0412 Wenzhang-Chen 2025-07-30 23:18:08 -04:00
• ee2ede0412
  Merge pull request #1466 from kvcache-ai/update-readme-djw main Jianwei Dong 2025-07-31 11:15:28 +08:00
• 5771990a07 update smallthinker and glm4 readme update-readme-djw djw 2025-07-31 03:14:49 +00:00
• d24b2f06ca
  Merge d7a80b54c9 into 757add1a39 steve green 2025-07-28 13:52:42 -04:00
• e82219e201 deploy: 757add1a39 gh-pages ovowei 2025-07-27 09:20:13 +00:00
• 757add1a39
  Merge pull request #1456 from kvcache-ai/support-smt-glm4 Jianwei Dong 2025-07-27 17:20:00 +08:00
• d7a80b54c9
  Update install.bat: add --resume-retries 9 steve green 2025-07-27 10:16:03 +08:00
• d54809a71e
  Update install.sh: add --resume-retries 9 steve green 2025-07-27 10:15:04 +08:00
• 2f8ee01760
  Merge d03d92ba53 into 1677e90092 Jianwei Dong 2025-07-25 17:23:43 +00:00
• d03d92ba53 support glm4moe support-glm4 djw 2025-07-25 17:22:20 +00:00
• 1334ddc833 update readme support-smt-glm4 qiyuxinlin 2025-07-25 17:02:36 +00:00
• 9e1560bb82 GLM4 and SmallThinker qiyuxinlin 2025-07-25 16:56:36 +00:00
• c7307aa0ae support smt and glm4 djw 2025-07-25 16:24:38 +00:00
• 17246bf84f support smt and glm4 djw 2025-07-25 15:03:27 +00:00
• 48bc6185b5 support smt and qlm4 djw 2025-07-25 12:48:51 +00:00
• 712ad1fa3c smallthinker right qiyuxinlin 2025-07-25 12:46:14 +00:00
• f8719ee7b9 Add use_silu in MOEConfig in python and hard-determine smallthinker Qiu Chengyu 2025-07-25 11:22:31 +00:00
• cb808979fa Add use_silu in MOEConfig on cpu Qiu Chengyu 2025-07-25 10:57:01 +00:00
• 71c1d4eed7 smallthink run qiyuxinlin 2025-07-24 15:08:29 +00:00
• 590fcb41cd support smt and glm4 djw 2025-07-24 12:31:01 +00:00
• 613f0b7c37 support smt and glm4 djw 2025-07-24 09:39:19 +00:00
• b66d96db97 support smt and glm4 djw 2025-07-24 08:40:58 +00:00
• 34cd6c5b3b fix typo Wenzhang-Chen 2025-07-23 21:39:09 +08:00
• b982815325 support npu support-npu Dongjw 2025-07-23 09:54:55 +00:00
• a641aa8063 support npu djw 2025-07-22 10:44:56 +00:00
• 7d51a13c9b support npu djw 2025-07-21 12:26:14 +00:00
• dd0e41b3b8 support npu djw 2025-07-21 04:05:15 +00:00
• f862af2b14
  Merge db3f5120fa into 1677e90092 Yaochen Han 2025-07-15 09:52:16 +08:00
• 1677e90092
  Merge pull request #1439 from kvcache-ai/qiyuxinlin-patch-3 wang jiahao 2025-07-12 13:14:54 +08:00
• a2e95e467a
  Update balance_serve.py qiyuxinlin-patch-3 wang jiahao 2025-07-12 13:14:35 +08:00
• dc59af6167
  Merge pull request #1438 from kvcache-ai/update-readme UnicornChan 2025-07-12 12:52:52 +08:00
• b5024f62a4 Update Kimi-K2 Readme update-readme chenxl 2025-07-12 12:51:00 +08:00
• 4fb367542b
  Merge pull request #1437 from kvcache-ai/Atream-patch-5 Atream 2025-07-12 12:44:52 +08:00
• 34d2829f24
  Update Kimi-K2.md Atream-patch-5 Atream 2025-07-12 12:44:41 +08:00
• df19681ec4
  Merge pull request #1436 from kvcache-ai/Atream-patch-4 Atream 2025-07-12 11:58:25 +08:00
• 90245d8a6b
  Update Kimi-K2.md Atream-patch-4 Atream 2025-07-12 11:57:51 +08:00
• 8e2c67d655
  Merge pull request #1435 from kvcache-ai/Atream-patch-3 Atream 2025-07-12 11:48:08 +08:00
• 378e4fc035
  Update Kimi-K2.md Atream-patch-3 Atream 2025-07-12 11:47:42 +08:00
• 5d4a644456
  Merge pull request #1434 from kvcache-ai/Atream-patch-2 Atream 2025-07-11 23:26:35 +08:00
• b4ed8b6ded
  Update Kimi-K2.md Atream-patch-2 Atream 2025-07-11 23:26:18 +08:00
• 83c8e7928e
  Merge pull request #1432 from kvcache-ai/UnicornChan-patch-1 UnicornChan 2025-07-11 19:32:42 +08:00
• 7800a413a2
  Update Kimi-K2.md UnicornChan-patch-1 UnicornChan 2025-07-11 19:31:58 +08:00
• 2303889709
  Merge pull request #1431 from kvcache-ai/support-kimi-k2 Atream 2025-07-11 09:36:01 +08:00
• cf79c93fae
  Update README.md support-kimi-k2 Atream 2025-07-11 09:35:12 +08:00
• 18690d819f
  Update README.md Atream 2025-07-11 09:34:07 +08:00
• b4ac21454b
  Create Kimi-K2.md Atream 2025-07-11 09:31:47 +08:00
• a6ab9e349c Implement multi-batch support for v2, v3, and r1 models with backend_type configured as ktransformers. jiafei96 2025-07-09 09:09:47 +00:00
• 8c8cb207aa Apply magikRUKKOLA's patch from issue #1417 Jesse CreateThis 2025-07-06 19:45:06 +00:00
• 890b0f1622
  Merge pull request #1410 from kvcache-ai/Atream-patch-1 Atream 2025-07-01 16:43:42 +08:00
• 5bd40c33eb
  Update __init__.py Atream-patch-1 Atream 2025-07-01 16:43:19 +08:00
• f96aab3c85
  Merge pull request #1409 from rnwang04/fix_fp16 aubreyli 2025-07-01 15:00:41 +08:00
• 5b5deda420 revert using FP16 rnwang04 2025-07-01 14:24:27 +08:00
• 495ae37478
  Merge pull request #1407 from kvcache-ai/v0.3.2 v0.3.2 ErvinXie 2025-07-01 10:26:56 +08:00
• 90cff820cf update kvc disk path config. v0.3.2 ouqingliang 2025-06-30 15:09:35 +00:00
• aadf31b35d
  Update README.md ErvinXie 2025-06-30 17:55:49 +08:00
• 5a73aaf652
  Update prefix_cache.md ErvinXie 2025-06-30 15:04:37 +08:00
• a9a72e52c3
  Update README.md ErvinXie 2025-06-30 14:56:46 +08:00
• d3fae09252
  Merge pull request #1405 from kvcache-ai/prefix-cache ErvinXie 2025-06-30 14:39:26 +08:00
• cc822df65d add prefix cache documentation prefix-cache ouqingliang 2025-06-28 07:13:33 +00:00
• 4d51831316 fix MPSC ouqingliang 2025-06-26 13:11:40 +00:00
• 3b4a1c7532 add prefix cache support for kvc2. ouqingliang 2025-06-26 04:57:25 +00:00
• b154441072 add prefix cache to kvc2. ouqingliang 2025-06-26 04:56:43 +00:00
• a289d3f598
  Merge branch 'kvcache-ai:main' into main Johnny 2025-06-25 08:56:03 +02:00
• ee5ee1103b
  Merge pull request #1399 from KMSorSMS/main ZiWei Yuan 2025-06-23 21:10:04 +08:00
• be13587fe6
  Merge branch 'kvcache-ai:main' into main ZiWei Yuan 2025-06-23 21:09:10 +08:00
• 22d0d9ccb2 ✨ update vendor ZTE name liam Yuan 2025-06-23 21:07:17 +08:00
• 06e45fd7d1
  Merge pull request #1398 from KMSorSMS/main ZiWei Yuan 2025-06-23 21:04:19 +08:00
• cb77b52c63 ✨ update vendor support list liam Yuan 2025-06-23 21:00:01 +08:00
• 90888fee0d
  Merge pull request #1372 from JaydenChao101/patch-1 ZiWei Yuan 2025-06-15 21:08:53 +08:00
• 64ec0ec148
  Merge pull request #1379 from aubreyli/main Azure 2025-06-11 16:05:04 +08:00
• 0dce748549 Add ABI args to compile KTransformersOps zydxt 2025-06-03 19:53:33 +08:00
• b599111b04 Load DS-R1-0528 for module is BaseInjectedModule instance Aubrey Li 2025-06-10 11:31:58 +08:00
• 2637d285bf
  Update pyproject.toml Jayden Chao 2025-06-07 21:28:49 +08:00
• dcba29b291
  Merge pull request #1366 from zhouye/main wang jiahao 2025-06-07 18:14:00 +08:00
• 255c0fcf3b Fix kv_b_proj shape for unsloth quantized models Ye Zhou 2025-06-05 17:33:11 +08:00
• bd800e2601 fix scheduler's query cancal add_query_cancel ouqingliang 2025-06-05 06:04:59 +00:00
• 76c902ff2d
  make kv_b_proj contiguous make-kv_b_proj-contiguous Atream 2025-06-04 17:39:28 +08:00
• 7071970339
  Merge pull request #1343 from zhouye/main Atream 2025-06-02 16:07:04 +08:00
• cc367f5814
  Merge pull request #1351 from kvcache-ai/load-DeepSeek-0528 Atream 2025-06-01 19:13:57 +08:00
• a6b3243a56 [Patch] lload DeepSeek-R1-0528 load-DeepSeek-0528 qiyuxinlin 2025-05-31 14:19:20 +00:00
• ac48a58cca
  Merge pull request #1350 from kvcache-ai/Update-WeChatGroup Atream 2025-05-31 13:34:14 +08:00
• 44143d972f
  Add files via upload Update-WeChatGroup Atream 2025-05-31 13:33:36 +08:00
• d8bc6402b5
  raise exception on device error (#1342) Emmanuel Ferdman 2025-05-29 10:37:41 +03:00
• 00949d5e8d Mirror #1247 in server mode Ye Zhou 2025-05-29 15:30:26 +08:00
• b0f97ccb34
  Raise exception on device error Emmanuel Ferdman 2025-05-29 00:25:25 -07:00
• 887930dee1
  display the unavailable torch device on error Emmanuel Ferdman 2025-05-28 07:51:22 -07:00