vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-04-28 11:40:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

hparams : add n_embd_inp() to support extended embed (#16928)

Browse source 
* add n_embd_full to support extended embed

* don't change output

* rename to n_embd_inp

* restore n_embd where applicable
This commit is contained in:
Sigbjørn Skjæret 2025-11-07 19:27:58 +01:00 • committed by GitHub
parent 16bcc1259d
commit 9008027aa3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
9 changed files with 29 additions and 28 deletions
Download patch file Download diff file Expand all files Collapse all files

2
tools/mtmd/mtmd.cpp
View file

@ -163,7 +163,7 @@ struct mtmd_context {
print_timings(ctx_params.print_timings),
n_threads (ctx_params.n_threads),
media_marker (ctx_params.media_marker),
n_embd_text (llama_model_n_embd(text_model))
n_embd_text (llama_model_n_embd_inp(text_model))
{
if (std::string(ctx_params.image_marker) != MTMD_DEFAULT_IMAGE_MARKER) {
throw std::runtime_error("custom image_marker is not supported anymore, use media_marker instead");