kvcache-ai-ktransformers/ktransformers/server
2025-07-22 10:58:25 +00:00
..
api fix load default max_new_tokens 2025-04-25 04:20:12 +00:00
backend support npu 2025-07-22 10:58:25 +00:00
balance_serve update kvc disk path config. 2025-06-30 15:09:35 +00:00
config update kvc disk path config. 2025-06-30 15:09:35 +00:00
crud Initial commit 2024-07-27 16:06:58 +08:00
models Initial commit 2024-07-27 16:06:58 +08:00
schemas fix load default max_new_tokens 2025-04-25 04:20:12 +00:00
utils support npu 2025-07-22 10:58:25 +00:00
__init__.py Initial commit 2024-07-27 16:06:58 +08:00
args.py support npu 2025-07-22 10:58:25 +00:00
exceptions.py Initial commit 2024-07-27 16:06:58 +08:00
main.py support npu 2025-07-22 10:58:25 +00:00
requirements.txt support qwen3, dont speak human language 2025-04-28 08:44:47 +00:00