qiyuxinlin 4f9950e30c kill serve lead to kill sched and engine		2025-04-22 09:25:44 +00:00
..
api	update speed test	2025-04-22 07:38:05 +00:00
backend	kill serve lead to kill sched and engine	2025-04-22 09:25:44 +00:00
balance_serve	remove hard code max_length	2025-04-18 12:11:18 +08:00
config	Update config.py	2025-04-16 17:32:08 +08:00
crud	Initial commit	2024-07-27 16:06:58 +08:00
models	Initial commit	2024-07-27 16:06:58 +08:00
schemas	update speed test	2025-04-22 07:38:05 +00:00
utils	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00
__init__.py	Initial commit	2024-07-27 16:06:58 +08:00
args.py	format kvc2, delete quant_configs, move model_configs to ~/.ktransformers	2025-04-08 10:06:07 +00:00
exceptions.py	Initial commit	2024-07-27 16:06:58 +08:00
main.py	Move KV cache creation to balance_serve	2025-04-18 10:10:07 +00:00
requirements.txt	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00