mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-08-30 02:34:00 +00:00
1138b851fa
This commit updates the python script that runs the original model to generate embeddings for the causal model, to use save_output_data which stores the token ids and the prompt in addition to logits. The motivation for this is that the embedding logits verification will fail as it expects these files (-prompt.txt and -tokens.bin) to exist. With the changes in this commit the causal-verify-embeddings target works again. |
||
|---|---|---|
| .. | ||
| compare-embeddings-logits.sh | ||
| compare-logits.py | ||
| convert-model.sh | ||
| modelcard.template | ||
| run-casual-gen-embeddings-org.py | ||
| run-converted-model-embeddings-logits.sh | ||
| run-converted-model.sh | ||
| run-org-model.py | ||