vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-09 13:55:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

🚑️: back transformer.py bugs version, and fix typo error in local_chat.py

Browse source
This commit is contained in:
liam 2024-10-28 21:09:40 +08:00
parent dd1d8667f3
commit 7c94df4bcf
2 changed files with 19 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

2
ktransformers/local_chat.py
View file

@ -91,7 +91,7 @@ def local_chat():
generated = asyncio.run(async_inference(messages))
his_content += [
{"role": "user", "content": content},
{"role": "assitant", "content": generated},
{"role": "assistant", "content": generated},
]