vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-10 23:34:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
369 commits 42 branches 19 tags 46 MiB
Commit graph

10 commits

Author SHA1 Message Date
liam
0ca0b99fab ⚡ update git ignore add docker dev container 2025-02-25 17:22:11 +08:00
Azure
ca7366d2db Merge remote-tracking branch 'upstream/develop-0.2.2' into support-fp8 2025-02-24 11:58:10 +00:00
Azure
581a524f65 Add data loader to read special weights for fp8; Add special weight process script 2025-02-24 11:34:17 +00:00
Azure
7b7c6a657d Add fp8 linear kernel;\n Add empty cache to fit in 16G VRAM; By 'wkGCaSS - 知乎 https://zhuanlan.zhihu.com/p/25491611225' 2025-02-22 13:05:08 +00:00
liam
97e1dc97f6 ⚡ fix .so bug 2025-02-20 21:24:46 +08:00
liam
592e13d453 ⚡ add mmlu_pro test 2025-02-18 14:43:38 +08:00
liam
07a0555016 ⚡ fix device and add test 2025-02-18 12:52:17 +08:00
TangJingqi
67043b4b5c [fix] format classes and files name 2024-08-15 10:44:59 +08:00
chenxl
f5f79f5c0e [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
chenxl
18c42e67df Initial commit 2024-07-27 16:06:58 +08:00