kvcache-ai-ktransformers/ktransformers
2025-05-01 08:13:09 +08:00
..
configs format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
ktransformers_ext add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
models fix-hopper-flashinfer 2025-04-29 11:06:34 +08:00
operators fix-hopper-flashinfer 2025-04-29 11:06:34 +08:00
optimize change inject yaml 2025-04-29 08:09:39 +00:00
server fix-cache-lens 2025-04-30 03:37:43 +00:00
tests fix-client 2025-04-29 12:34:20 +08:00
util ktransformers/utils: fix _get_logits_warper error 2025-05-01 08:13:09 +08:00
website : refactor local_chat and fix message slice bug in server 2024-11-04 14:02:19 +08:00
__init__.py Update version info in __init__.py 2025-04-29 09:58:40 +08:00
local_chat.py add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
local_chat_test.py fix some bugs 2025-04-17 00:48:09 +08:00