vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-05-17 04:09:19 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

common : only load backends when required (#22290)

Browse source 
* common : only load backends when required

Signed-off-by: Adrien Gallouët <angt@huggingface.co>

* llama : call ggml_backend_load_all() directly from llama_backend_init()

Signed-off-by: Adrien Gallouët <angt@huggingface.co>

* Add ggml_backend_load_all() where llama_backend_init() is not used

Signed-off-by: Adrien Gallouët <angt@huggingface.co>

---------

Signed-off-by: Adrien Gallouët <angt@huggingface.co>
This commit is contained in:
Adrien Gallouët 2026-05-05 09:23:50 +02:00 • committed by GitHub
parent a09a00e502
commit bf76ac77be
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 19 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

3
examples/save-load-state/save-load-state.cpp
View file

@ -41,6 +41,9 @@ int main(int argc, char ** argv) {
std::string result3;
// init
ggml_backend_load_all();
auto llama_init = common_init_from_params(params);
auto * model = llama_init->model();