vrr/prima.cpp
2
0
Fork 0
mirror of https://github.com/Lizonghang/prima.cpp.git synced 2025-09-10 11:24:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

add option --keep-inp-out-in-metal and fix bugs in unmap

Browse source
This commit is contained in:
Lizonghang 2025-01-22 11:15:19 +04:00
parent ce2ef9699f
commit facb4ea736
5 changed files with 142 additions and 131 deletions
Download patch file Download diff file Expand all files Collapse all files

1
include/llama.h
View file

@ -312,6 +312,7 @@ extern "C" {
bool use_mmap; // use mmap if possible
bool use_mlock; // force system to keep model in RAM
bool check_tensors; // validate model tensor data
bool keep_inp_out_in_metal; // whether to keep input/output weight in metal
};
// NOTE: changing the default values of parameters marked as [EXPERIMENTAL] may cause crashes or incorrect results in certain configurations