kvcache-ai-ktransformers/ktransformers/server/requirements.txt
2025-03-07 08:51:09 +00:00

14 lines
No EOL
196 B
Text

torch >= 2.3.0,<=2.3.1
transformers == 4.43.2
fastapi >= 0.111.0
langchain >= 0.2.0
blessed >= 1.20.0
accelerate >= 0.31.0
sentencepiece >= 0.1.97
openai
setuptools
build
ninja
wheel
colorlog
fire