vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-10 17:06:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

hparams : refactor hparams.n_layer (#24060)

Browse source 
* hparams : refactor hparams.n_layer

* cont : remove `n_layer_kv()`, use n_layer_all instead

* cont : type consistency

* pi : update SYSTEM.md

* models : fix Step3.5 MTP

* cont : remove duplicate switch cases

* cont : explicitly set `false` to extra layers for `is_swa` and `is_recr`

* cont : fix nextn layer count handling

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
This commit is contained in:
Georgi Gerganov 2026-06-05 11:09:36 +03:00 • committed by GitHub
parent 3ecfb150a4
commit 7acb4e8cd2
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
129 changed files with 412 additions and 431 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/llama-graph.cpp
View file

@ -1005,7 +1005,7 @@ llm_graph_context::llm_graph_context(const llm_graph_params & params) :
cparams (params.cparams),
ubatch (params.ubatch),
n_embd (hparams.n_embd),
n_layer (hparams.n_layer),
n_layer (hparams.n_layer()),
n_rot (hparams.n_rot()),
n_ctx (cparams.n_ctx),
n_head (hparams.n_head()),