qiyuxinlin 38e841900d Move KV cache creation to balance_serve		2025-04-18 10:10:07 +00:00
..
api	Merge pull request #978 from cyhasuka/main	2025-04-17 14:34:35 +08:00
backend	Move KV cache creation to balance_serve	2025-04-18 10:10:07 +00:00
balance_serve	format kvc2, delete quant_configs, move model_configs to ~/.ktransformers	2025-04-08 10:06:07 +00:00
config	Update config.py	2025-04-16 17:32:08 +08:00
crud	Initial commit	2024-07-27 16:06:58 +08:00
models	Initial commit	2024-07-27 16:06:58 +08:00
schemas	Refactor the chat interface to support tool calling and parameter processing	2025-04-14 15:23:37 +08:00
utils	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00
__init__.py	Initial commit	2024-07-27 16:06:58 +08:00
args.py	format kvc2, delete quant_configs, move model_configs to ~/.ktransformers	2025-04-08 10:06:07 +00:00
exceptions.py	Initial commit	2024-07-27 16:06:58 +08:00
main.py	Move KV cache creation to balance_serve	2025-04-18 10:10:07 +00:00
requirements.txt	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00