vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-09 13:55:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge branch 'main' into temperature_top_p_from_request

Browse source
This commit is contained in:
wang jiahao 2025-02-27 18:08:55 +08:00 • committed by GitHub
commit 26f7b4af11
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
54 changed files with 1573 additions and 159 deletions
Download patch file Download diff file Expand all files Collapse all files

2
ktransformers/server/schemas/endpoints/chat.py
View file

@ -77,4 +77,4 @@ class ChatCompletionChunk(ChatCompletionBase):
]
def to_stream_reply(self):
return f"data:{self.model_dump_json()}\n\n"
return f"data: {self.model_dump_json()}\n\n"