vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-03 21:23:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
koboldcpp/src/models
History
Michael Wand 4988f6e866
Add arch support for cohere2-MoE (#24260) 
* Add arch support for cohere2-MoE

* Removed redundant gating_func checks

* Changed ffn lookup to prefer prefix_dense_intermediate_size

* Renamed arch to cohere2moe

* Removed redundant lmhead check and chat template changes

* Removed lm_head.weight check from modify tensors, load output tensor not required, fallback to token_embd.weight

* Changed to (routed+shared)*0.5 for shared expert combined avg

* fixed sliding_window_pattern issue and pattern

* Fixed transformers crash 'first_k_dense_replace' error

* Remove comment

* Removed cohere2-moe as a tokenizer type and kept as tiny_aya.  Renamed North-Mini-Code-1.0.

* Fixed MTP fail, changed to use iSWA

* Fixed remaining todos: cohere2moe renamed, changed swa parsing to use get_key_or_arr, removed extra get_arr use

* Force metadata usage

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Remove Cohere2 checkpoint comment

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Remove MTP comment

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Regenerate cohere2moe tokenizer hash

* Add cohere2moe to Llama Model Saver supported list

* Check for zerobios tensors and add support for Command to use LayerNorm

* Map expert_selection_fn to sigmoid in base.py instead of command.py

* use bools for foundnorm/foundnormrms

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
2026-06-13 19:49:00 +02:00
..
afmoe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
apertus.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
arcee.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
arctic.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
arwkv7.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
baichuan.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
bailingmoe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
bailingmoe2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
bert.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
bitnet.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
bloom.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
chameleon.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
chatglm.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
codeshell.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
cogvlm.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
cohere2.cpp Add arch support for cohere2-MoE (#24260) 2026-06-13 19:49:00 +02:00
cohere2moe.cpp Add arch support for cohere2-MoE (#24260) 2026-06-13 19:49:00 +02:00
command-r.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
dbrx.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
deci.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
deepseek.cpp model : NvFP4 quantized LM head support (#23046) 2026-05-16 11:09:27 +02:00
deepseek2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
deepseek2ocr.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
deepseek32.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
delta-net-base.cpp Remove padding and multiple D2D copies for MTP (#24086) 2026-06-10 23:21:16 +05:30
dots1.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
dream.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
eagle3.cpp spec: add EAGLE3 speculative decoding support (#18039) 2026-06-12 10:21:06 +03:00
ernie4-5-moe.cpp model : NvFP4 quantized LM head support (#23046) 2026-05-16 11:09:27 +02:00
ernie4-5.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
eurobert.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
exaone-moe.cpp minor : fix lint issues (#24165) 2026-06-05 11:17:54 +03:00
exaone.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
exaone4.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
falcon-h1.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
falcon.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gemma-embedding.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gemma.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gemma2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gemma3.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gemma3n.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gemma4-assistant.cpp mtp: support for gemma-4 E2B and E4B assistants (#24282) 2026-06-08 13:48:52 -07:00
gemma4.cpp spec: add EAGLE3 speculative decoding support (#18039) 2026-06-12 10:21:06 +03:00
glm-dsa.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
glm4-moe.cpp minor : fix lint issues (#24165) 2026-06-05 11:17:54 +03:00
glm4.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gpt2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
gptneox.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
granite-hybrid.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
granite-moe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
granite.cpp model, mtmd: Granite4 Vision (#23545) 2026-06-05 17:44:59 +02:00
grok.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
grovemoe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
hunyuan-dense.cpp model: move load_hparams and load_tensors to per-model definition (#22004) 2026-05-04 12:36:59 +02:00
hunyuan-moe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
hunyuan-vl.cpp model : NvFP4 quantized LM head support (#23046) 2026-05-16 11:09:27 +02:00
internlm2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
jais.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
jais2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
jamba.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
jina-bert-v2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
jina-bert-v3.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
kimi-linear.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
lfm2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
lfm2moe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
llada-moe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
llada.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
llama-embed.cpp model: move load_hparams and load_tensors to per-model definition (#22004) 2026-05-04 12:36:59 +02:00
llama.cpp spec: add EAGLE3 speculative decoding support (#18039) 2026-06-12 10:21:06 +03:00
llama4.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
maincoder.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
mamba-base.cpp model : wire up Nemotron-H tensors for NVFP4 support (#20561) 2026-03-16 09:19:16 +01:00
mamba.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
mamba2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
mellum.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
mimo2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
minicpm.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
minicpm3.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
minimax-m2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
mistral3.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
mistral4.cpp model: move load_hparams and load_tensors to per-model definition (#22004) 2026-05-04 12:36:59 +02:00
models.h Add arch support for cohere2-MoE (#24260) 2026-06-13 19:49:00 +02:00
modern-bert.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
mpt.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
nemotron-h-moe.cpp model: move load_hparams and load_tensors to per-model definition (#22004) 2026-05-04 12:36:59 +02:00
nemotron-h.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
nemotron.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
neo-bert.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
nomic-bert-moe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
nomic-bert.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
olmo.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
olmo2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
olmoe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
openai-moe.cpp spec: add EAGLE3 speculative decoding support (#18039) 2026-06-12 10:21:06 +03:00
openelm.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
orion.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
paddleocr.cpp model : NvFP4 quantized LM head support (#23046) 2026-05-16 11:09:27 +02:00
pangu-embed.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
phi2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
phi3.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
phimoe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
plamo.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
plamo2.cpp models : fix plamo2 attention_key/value_length regression (#24317) 2026-06-09 10:26:44 +03:00
plamo3.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
plm.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
qwen.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
qwen2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
qwen2moe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
qwen2vl.cpp model : NvFP4 quantized LM head support (#23046) 2026-05-16 11:09:27 +02:00
qwen3.cpp spec: add EAGLE3 speculative decoding support (#18039) 2026-06-12 10:21:06 +03:00
qwen3moe.cpp spec: add EAGLE3 speculative decoding support (#18039) 2026-06-12 10:21:06 +03:00
qwen3next.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
qwen3vl.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
qwen3vlmoe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
qwen35.cpp spec: add EAGLE3 speculative decoding support (#18039) 2026-06-12 10:21:06 +03:00
qwen35moe.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
refact.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
rnd1.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
rwkv6-base.cpp models : deduplicate delta-net graphs for Qwen family (#19597) 2026-02-16 14:35:04 +02:00
rwkv6.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
rwkv6qwen2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
rwkv7-base.cpp models : deduplicate delta-net graphs for Qwen family (#19597) 2026-02-16 14:35:04 +02:00
rwkv7.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
seed-oss.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
smallthinker.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
smollm3.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
stablelm.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
starcoder.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
starcoder2.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
step35.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
t5.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
t5encoder.cpp model: move load_hparams and load_tensors to per-model definition (#22004) 2026-05-04 12:36:59 +02:00
talkie.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00
wavtokenizer-dec.cpp model : NvFP4 quantized LM head support (#23046) 2026-05-16 11:09:27 +02:00
xverse.cpp hparams : refactor hparams.n_layer (#24060) 2026-06-05 11:09:36 +03:00