kvcache-ai-ktransformers/ktransformers
2025-04-22 07:38:05 +00:00
..
configs format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
ktransformers_ext add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
models fix no balance_serve import error 2025-04-22 02:11:18 +00:00
operators fix some bugs 2025-04-17 00:48:09 +08:00
optimize rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
server update speed test 2025-04-22 07:38:05 +00:00
tests update speed test 2025-04-22 07:38:05 +00:00
util update install doc and fix local_chat bug 2025-04-03 12:42:41 +08:00
website : refactor local_chat and fix message slice bug in server 2024-11-04 14:02:19 +08:00
__init__.py 🔖 release v0.2.4post1 2025-04-04 16:01:25 +08:00
local_chat.py add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
local_chat_test.py fix some bugs 2025-04-17 00:48:09 +08:00