kvcache-ai-ktransformers/ktransformers
2025-08-05 15:24:17 +08:00
..
configs support smt and glm4 2025-07-25 15:03:27 +00:00
ktransformers_ext add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
models Merge 8c8cb207aa into ee2ede0412 2025-08-05 15:24:17 +08:00
operators GLM4 and SmallThinker 2025-07-25 16:56:36 +00:00
optimize support smt and qlm4 2025-07-25 12:48:51 +00:00
server Merge 8c8cb207aa into ee2ede0412 2025-08-05 15:24:17 +08:00
tests GLM4 and SmallThinker 2025-07-25 16:56:36 +00:00
util support smt and glm4 2025-07-24 12:31:01 +00:00
website : refactor local_chat and fix message slice bug in server 2024-11-04 14:02:19 +08:00
__init__.py Update __init__.py 2025-07-01 16:43:19 +08:00
ktransformers support smt and glm4 2025-07-24 08:40:58 +00:00
local_chat.py revert using FP16 2025-07-01 14:24:27 +08:00
local_chat_test.py fix some bugs 2025-04-17 00:48:09 +08:00