koboldcpp/examples/model-conversion/scripts/causal
Daniel Bevenius 1138b851fa
model-conversion : use save_output_data for causual embeddings [no ci] (#26890)
This commit updates the python script that runs the original model to
generate embeddings for the causal model, to use save_output_data which
stores the token ids and the prompt in addition to logits.

The motivation for this is that the embedding logits verification will
fail as it expects these files (-prompt.txt and -tokens.bin) to exist.
With the changes in this commit the causal-verify-embeddings target
works again.
2026-08-11 11:41:38 +02:00
..
compare-embeddings-logits.sh
compare-logits.py
convert-model.sh
modelcard.template
run-casual-gen-embeddings-org.py model-conversion : use save_output_data for causual embeddings [no ci] (#26890) 2026-08-11 11:41:38 +02:00
run-converted-model-embeddings-logits.sh
run-converted-model.sh
run-org-model.py