vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-05-21 02:19:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

graph : remove redundant scale_w parameter (#20235)

Browse source
This commit is contained in:
Sigbjørn Skjæret 2026-03-08 18:58:28 +01:00 • committed by GitHub
parent 451ef08432
commit 35bee031e1
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
41 changed files with 85 additions and 86 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/models/phi3.cpp
View file

@ -114,7 +114,7 @@ llm_build_phi3<iswa>::llm_build_phi3(const llama_model & model, const llm_graph_
nullptr,
n_expert, n_expert_used,
LLM_FFN_SILU, true,
false, 0.0,
hparams.expert_weights_scale,
LLAMA_EXPERT_GATING_FUNC_TYPE_SOFTMAX,
il);
cb(cur, "ffn_moe_out", il);