vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-16 01:59:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
kvcache-ai-ktransformers/ktransformers/server
History
kevin c8db24d5eb
Update config.py 
Update config.py
2025-04-16 17:32:08 +08:00
..
api Refactor the chat interface to support tool calling and parameter processing 2025-04-14 15:23:37 +08:00
backend Refactor the chat interface to support tool calling and parameter processing 2025-04-14 15:23:37 +08:00
balance_serve format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
config Update config.py 2025-04-16 17:32:08 +08:00
crud Initial commit 2024-07-27 16:06:58 +08:00
models Initial commit 2024-07-27 16:06:58 +08:00
schemas Refactor the chat interface to support tool calling and parameter processing 2025-04-14 15:23:37 +08:00
utils add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
__init__.py Initial commit 2024-07-27 16:06:58 +08:00
args.py format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
exceptions.py Initial commit 2024-07-27 16:06:58 +08:00
main.py add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
requirements.txt add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00