mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-08-10 17:06:13 +00:00
0ef6e55edb
* common/chat: update DeepSeek V4 templates Align the DeepSeek V4 templates with the official encoders while keeping parser behavior out of this change. - Default drop_thinking for DeepSeek V4 history so prior thinking is omitted unless preserve_reasoning is requested or tools are present. - Add structured output response-format instructions to the V4 templates and pass the schema into template rendering. - Add a separate Flash 0731 template for the updated high and max reasoning effort mapping. - Cover reasoning effort, drop_thinking, structured output prompts, preserved reasoning, continuations, and empty tool arguments in template rendering tests. Official references: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash/blob/main/encoding/encoding_dsv4.py https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731/blob/main/encoding/encoding_dsv4.py Assisted-by: Codex * Fix deepseek v4 0731 template selection * remove unneeded lower normalization * Fix DSML parser to consume the tool call separator * address aldehir requests * address aldehir comment |
||
|---|---|---|
| .. | ||
| templates | ||
| .editorconfig | ||
| ggml-vocab-aquila.gguf | ||
| ggml-vocab-baichuan.gguf | ||
| ggml-vocab-bert-bge.gguf | ||
| ggml-vocab-bert-bge.gguf.inp | ||
| ggml-vocab-bert-bge.gguf.out | ||
| ggml-vocab-command-r.gguf | ||
| ggml-vocab-command-r.gguf.inp | ||
| ggml-vocab-command-r.gguf.out | ||
| ggml-vocab-deepseek-coder.gguf | ||
| ggml-vocab-deepseek-coder.gguf.inp | ||
| ggml-vocab-deepseek-coder.gguf.out | ||
| ggml-vocab-deepseek-llm.gguf | ||
| ggml-vocab-deepseek-llm.gguf.inp | ||
| ggml-vocab-deepseek-llm.gguf.out | ||
| ggml-vocab-falcon.gguf | ||
| ggml-vocab-falcon.gguf.inp | ||
| ggml-vocab-falcon.gguf.out | ||
| ggml-vocab-gemma-4.gguf | ||
| ggml-vocab-gemma-4.gguf.inp | ||
| ggml-vocab-gemma-4.gguf.out | ||
| ggml-vocab-gpt-2.gguf | ||
| ggml-vocab-gpt-2.gguf.inp | ||
| ggml-vocab-gpt-2.gguf.out | ||
| ggml-vocab-gpt-neox.gguf | ||
| ggml-vocab-llama-bpe.gguf | ||
| ggml-vocab-llama-bpe.gguf.inp | ||
| ggml-vocab-llama-bpe.gguf.out | ||
| ggml-vocab-llama-spm.gguf | ||
| ggml-vocab-llama-spm.gguf.inp | ||
| ggml-vocab-llama-spm.gguf.out | ||
| ggml-vocab-mpt.gguf | ||
| ggml-vocab-mpt.gguf.inp | ||
| ggml-vocab-mpt.gguf.out | ||
| ggml-vocab-nomic-bert-moe.gguf | ||
| ggml-vocab-phi-3.gguf | ||
| ggml-vocab-phi-3.gguf.inp | ||
| ggml-vocab-phi-3.gguf.out | ||
| ggml-vocab-qwen2.gguf | ||
| ggml-vocab-qwen2.gguf.inp | ||
| ggml-vocab-qwen2.gguf.out | ||
| ggml-vocab-qwen35.gguf | ||
| ggml-vocab-qwen35.gguf.inp | ||
| ggml-vocab-qwen35.gguf.out | ||
| ggml-vocab-refact.gguf | ||
| ggml-vocab-refact.gguf.inp | ||
| ggml-vocab-refact.gguf.out | ||
| ggml-vocab-starcoder.gguf | ||
| ggml-vocab-starcoder.gguf.inp | ||
| ggml-vocab-starcoder.gguf.out | ||