Commit graph

779 commits

Author SHA1 Message Date
wang jiahao
2d3aaef8b6
Merge pull request #1301 from kvcache-ai/update-readme
Some checks failed
Book-CI / test (push) Has been cancelled
Deploy / deploy (macos-latest) (push) Has been cancelled
Deploy / deploy (ubuntu-latest) (push) Has been cancelled
Deploy / deploy (windows-latest) (push) Has been cancelled
update readme
2025-05-14 21:15:55 +08:00
qiyuxinlin
d35d61f6a1 update readme 2025-05-14 13:15:18 +00:00
qiyuxinlin
c3d0ac80c6 update readme 2025-05-14 13:13:10 +00:00
wang jiahao
ee524b0f41
Merge pull request #1300 from kvcache-ai/qiyuxinlin-patch-1
Update install.sh
2025-05-14 21:09:20 +08:00
wang jiahao
9fe3f35c37
Update install.sh 2025-05-14 21:08:58 +08:00
aubreyli
f7ee993fdc
Merge pull request #1295 from rnwang04/xpu_support
Enable ktransformers on Intel GPU with local chat backend
2025-05-14 20:58:35 +08:00
rnwang04
142fb7ce6c Enable support for Intel XPU devices, add support for DeepSeek V2/V3 first 2025-05-14 19:37:27 +00:00
wang jiahao
333351c7c8
Merge pull request #1298 from kvcache-ai/fix-workspace-buffer
Some checks are pending
Book-CI / test (push) Waiting to run
Deploy / deploy (macos-latest) (push) Waiting to run
Deploy / deploy (ubuntu-latest) (push) Waiting to run
Deploy / deploy (windows-latest) (push) Waiting to run
update norm cpu kernel
2025-05-14 17:50:40 +08:00
qiyuxinlin
ecc01cda17 update norm cpu kernel 2025-05-14 09:49:35 +00:00
wang jiahao
8974cc9d75
Merge pull request #1297 from kvcache-ai/fix-workspace-buffer
update torch MLA kernel
2025-05-14 17:46:55 +08:00
qiyuxinlin
64742bec83 update torch MLA kernel 2025-05-14 09:45:12 +00:00
wang jiahao
4e015ccc65
Merge pull request #1296 from kvcache-ai/fix-workspace-buffer
fix flashinfer float_workspace_buffer small
2025-05-14 17:35:27 +08:00
qiyuxinlin
e8e83308a9 fix flashinfer float_workspace_buffer small 2025-05-14 09:33:52 +00:00
wang jiahao
02948bc1b8
Merge pull request #1289 from kvcache-ai/update-default-config
Some checks are pending
Book-CI / test (push) Waiting to run
Deploy / deploy (macos-latest) (push) Waiting to run
Deploy / deploy (ubuntu-latest) (push) Waiting to run
Deploy / deploy (windows-latest) (push) Waiting to run
update default config
2025-05-13 20:23:25 +08:00
qiyuxinlin
697444905a update default config 2025-05-13 12:20:21 +00:00
wang jiahao
8456222852
Merge pull request #1276 from kvcache-ai/support_load_safetensor
Some checks failed
Book-CI / test (push) Has been cancelled
Deploy / deploy (macos-latest) (push) Has been cancelled
Deploy / deploy (ubuntu-latest) (push) Has been cancelled
Deploy / deploy (windows-latest) (push) Has been cancelled
support safetensor load, delete architectures argument
2025-05-12 11:10:26 +08:00
qiyuxinlin
c6aa379de2 support safetensor load, delete architectures argument 2025-05-09 10:38:29 +00:00
Atream
30eab48a75
Merge pull request #799 from aubreyli/cpu_offloading
Some checks failed
Book-CI / test (push) Has been cancelled
Deploy / deploy (macos-latest) (push) Has been cancelled
Deploy / deploy (ubuntu-latest) (push) Has been cancelled
Deploy / deploy (windows-latest) (push) Has been cancelled
Restore CPU offloading capability
2025-05-09 00:38:54 -06:00
Atream
8025def197
Merge pull request #1246 from aubreyli/GenerationMixin
modeling_deepseek_v3: fix GenerationMixin warning
2025-05-09 00:35:15 -06:00
Atream
900a7f7c3e
Merge pull request #1271 from kvcache-ai/fix-AMX
Some checks failed
Book-CI / test (push) Has been cancelled
Deploy / deploy (macos-latest) (push) Has been cancelled
Deploy / deploy (ubuntu-latest) (push) Has been cancelled
Deploy / deploy (windows-latest) (push) Has been cancelled
fix AMX
2025-05-07 05:12:38 -06:00
Atream
b22cded890
fix AMX 2025-05-07 19:12:19 +08:00
Yaochen Han
3f14e311cb
Merge pull request #1247 from aubreyli/_get_logits_warper
ktransformers/utils: fix _get_logits_warper error
2025-05-07 15:22:35 +08:00
Aubrey Li
b3a1fcf471 ktransformers/utils: fix _get_logits_warper error 2025-05-01 08:13:09 +08:00
Aubrey Li
def1ec7683 modeling_deepseek_v3: fix GenerationMixin warning
Fix GenerationMixin warning introduced by upgrading transformers to 4.51.3.
2025-05-01 07:48:15 +08:00
Atream
7530491f5b
Merge pull request #1244 from kvcache-ai/update-custom-flashinfer
Some checks failed
Book-CI / test (push) Has been cancelled
Deploy / deploy (macos-latest) (push) Has been cancelled
Deploy / deploy (ubuntu-latest) (push) Has been cancelled
Deploy / deploy (windows-latest) (push) Has been cancelled
update-custom-flashinfer
2025-04-30 04:46:19 -06:00
Atream
753075728c update-custom-flashinfer 2025-04-30 10:45:25 +00:00
Atream
a4bd6818ed
Merge pull request #1241 from kvcache-ai/fix-cache-lens
fix-cache-lens
2025-04-29 21:38:12 -06:00
Atream
7adb7281f4 fix-cache-lens 2025-04-30 03:37:43 +00:00
wang jiahao
8ba7e5d4b8
Merge pull request #1227 from kvcache-ai/change-yaml
change inject yaml
2025-04-29 16:10:37 +08:00
qiyuxinlin
48dfbc8f9f change inject yaml 2025-04-29 08:09:39 +00:00
ZiWei Yuan
2a224b256e
Merge pull request #1225 from kvcache-ai/fix_typo_main
 update ignore
2025-04-29 13:26:02 +08:00
liam Yuan
0e8a36770a update ignore 2025-04-29 13:24:14 +08:00
ZiWei Yuan
c519747f3c
Merge pull request #1224 from kvcache-ai/fix_typo_main
 fix typo
2025-04-29 13:22:27 +08:00
liam Yuan
2762012039 fix typo 2025-04-29 13:20:03 +08:00
Atream
ab26e7d7db
Merge pull request #1223 from kvcache-ai/fix-client
fix-client
2025-04-28 22:35:04 -06:00
Atream
0f7a3e5fea fix-client 2025-04-29 12:34:20 +08:00
Atream
cc94a02ab5
Merge pull request #1222 from kvcache-ai/fix-compile
Fix compile
2025-04-28 22:13:09 -06:00
Atream
08035a7cda
Update requirements-local_chat.txt 2025-04-29 12:12:35 +08:00
Atream
fd9876049d
Update pyproject.toml 2025-04-29 12:11:11 +08:00
Atream
9d6e09efa6
Merge pull request #1221 from kvcache-ai/Atream-patch-5
Update AMX.md
2025-04-28 21:14:10 -06:00
Atream
28948aacc9
Update AMX.md 2025-04-29 11:12:51 +08:00
Atream
bee6291dc2
Merge pull request #1220 from kvcache-ai/fix-hopper-flashinfer
fix-hopper-flashinfer
2025-04-28 21:07:34 -06:00
Atream
b0318fc01c fix-hopper-flashinfer 2025-04-29 11:06:34 +08:00
Atream
b703cc9c3d
Merge pull request #1219 from kvcache-ai/Atream-patch-4
Update AMX.md
2025-04-28 21:04:12 -06:00
Atream
14efb15593
Update AMX.md 2025-04-29 11:03:59 +08:00
Atream
38333cf129
Merge pull request #1218 from kvcache-ai/clean-up
clean-up
2025-04-28 20:36:25 -06:00
Atream
192746cf93 clean-up 2025-04-29 10:32:42 +08:00
Atream
e4538bc013
Merge pull request #1217 from kvcache-ai/Atream-patch-3
Update AMX.md
2025-04-28 20:31:03 -06:00
Atream
073ce601e0
Update AMX.md 2025-04-29 10:29:51 +08:00
Atream
2bcdf10fbb
Merge pull request #1216 from kvcache-ai/Atream-patch-2
Update version info in __init__.py
2025-04-28 19:58:56 -06:00