vrr/open-notebook
2
0
Fork 0
mirror of https://github.com/lfnovo/open-notebook.git synced 2026-04-29 20:10:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: max tokens max is 8192 now

Browse source
This commit is contained in:
LUIS NOVO 2025-10-18 13:21:53 -03:00
parent 059ee29e18
commit 8b5daa86bc
3 changed files with 70 additions and 53 deletions
Download patch file Download diff file Expand all files Collapse all files

5
open_notebook/graphs/chat.py
View file

@ -42,8 +42,7 @@ def call_model_with_messages(state: ThreadState, config: RunnableConfig) -> dict
str(payload),
model_id,
"chat",
max_tokens=10000,
)
max_tokens=8192
)
finally:
new_loop.close()
@ -64,7 +63,7 @@ def call_model_with_messages(state: ThreadState, config: RunnableConfig) -> dict
str(payload),
model_id,
"chat",
max_tokens=10000,
max_tokens=8192,
)
)