vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-10 23:34:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update chat.py

Browse source
This commit is contained in:
Creeper-MZ 2025-04-16 15:54:23 -04:00
parent 88f688e2c8
commit 6bc2e85343
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
ktransformers/server/api/openai/endpoints/chat.py
View file

@ -128,7 +128,7 @@ def get_tool_instructions():
{"param1": "value1", "param2": "value2"} {"param1": "value1", "param2": "value2"}
```<｜tool▁call▁end｜><｜tool▁calls▁end｜> ```<｜tool▁call▁end｜><｜tool▁calls▁end｜>
Only use functions when needed. Ensure proper JSON formatting with appropriate parameters.""" Use functions when needed. Ensure proper JSON formatting with appropriate parameters."""
@router.post('/chat/completions', tags=['openai']) @router.post('/chat/completions', tags=['openai'])
async def chat_completion(request: Request, create: ChatCompletionCreate): async def chat_completion(request: Request, create: ChatCompletionCreate):