vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-06 20:49:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2
kvcache-ai-ktransformers/ktransformers
History
ceerrep ee24eb8dc3 fix: fix server for triton kernel
2025-02-17 18:08:45 +08:00
..
configs update rope calculation; update modeling.py; update gate for moe 2025-02-01 07:32:21 +00:00
ktransformers_ext toy support for experts on GPU, no CUDA Graph 2025-02-15 15:16:00 +00:00
models Merge branch 'fix_precision_MLA' of https://github.com/kvcache-ai/ktransformers into server-prefix-cache 2025-02-17 18:08:04 +08:00
operators Merge branch 'fix_precision_MLA' of https://github.com/kvcache-ai/ktransformers into server-prefix-cache 2025-02-17 18:08:04 +08:00
optimize toy support for experts on GPU, no CUDA Graph 2025-02-15 15:16:00 +00:00
server fix: fix server for triton kernel 2025-02-17 18:08:45 +08:00
tests [fix] format classes and files name 2024-08-15 10:44:59 +08:00
util fix precision bug imported by position_ids in 0.2.0 2025-02-17 09:23:14 +00:00
website ✨: refactor local_chat and fix message slice bug in server 2024-11-04 14:02:19 +08:00
__init__.py [feature] update docker image and entrypoint 2025-02-15 07:55:33 +00:00
local_chat.py fix precision bug imported by position_ids in 0.2.0 2025-02-17 09:23:14 +00:00