vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-06 20:49:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2
kvcache-ai-ktransformers/ktransformers/server
History
Creeper-MZ 88f688e2c8 更改token注入逻辑，减少token注入量，防止遗忘 
Update chat.py

Update chat.py

Update chat.py
2025-04-16 15:52:24 -04:00
..
api 更改token注入逻辑，减少token注入量，防止遗忘 2025-04-16 15:52:24 -04:00
backend updata function_call 2025-04-13 23:48:51 -04:00
balance_serve format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
config format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
crud Initial commit 2024-07-27 16:06:58 +08:00
models Initial commit 2024-07-27 16:06:58 +08:00
schemas updata function_call 2025-04-13 23:48:51 -04:00
utils add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
__init__.py Initial commit 2024-07-27 16:06:58 +08:00
args.py format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
exceptions.py Initial commit 2024-07-27 16:06:58 +08:00
main.py add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
requirements.txt add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00