Yuhao Tsui 877aec858e Merge branch 'kvcache-ai:main' into main		2025-04-09 11:46:39 +08:00
..
api	Update completions.py	2025-03-26 15:39:46 +08:00
backend	fix temperature=0, flashinfer sample error	2025-04-07 12:30:47 +08:00
balance_serve	format kvc2, delete quant_configs, move model_configs to ~/.ktransformers	2025-04-08 10:06:07 +00:00
config	format kvc2, delete quant_configs, move model_configs to ~/.ktransformers	2025-04-08 10:06:07 +00:00
crud	Initial commit	2024-07-27 16:06:58 +08:00
models	Initial commit	2024-07-27 16:06:58 +08:00
schemas	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00
utils	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00
__init__.py	Initial commit	2024-07-27 16:06:58 +08:00
args.py	format kvc2, delete quant_configs, move model_configs to ~/.ktransformers	2025-04-08 10:06:07 +00:00
exceptions.py	Initial commit	2024-07-27 16:06:58 +08:00
main.py	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00
requirements.txt	add balance-serve, support concurrence	2025-03-31 22:55:32 +08:00