kvcache-ai-ktransformers/ktransformers/server
Atream e44c45e782
Merge pull request #1163 from cyhasuka/main
Enh: Make Ollama perf data more accurate, consistent with OpenAI's implementation
2025-04-18 00:50:58 -06:00
..
api Modify the performance calculation module 2025-04-17 16:57:53 +08:00
backend Refactor the chat interface to support tool calling and parameter processing 2025-04-14 15:23:37 +08:00
balance_serve remove hard code max_length 2025-04-18 12:11:18 +08:00
config Update config.py 2025-04-16 17:32:08 +08:00
crud Initial commit 2024-07-27 16:06:58 +08:00
models Initial commit 2024-07-27 16:06:58 +08:00
schemas Refactor the chat interface to support tool calling and parameter processing 2025-04-14 15:23:37 +08:00
utils add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
__init__.py Initial commit 2024-07-27 16:06:58 +08:00
args.py format kvc2, delete quant_configs, move model_configs to ~/.ktransformers 2025-04-08 10:06:07 +00:00
exceptions.py Initial commit 2024-07-27 16:06:58 +08:00
main.py add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
requirements.txt add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00