vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-05-10 04:00:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fit-params : refactor + add option to output estimated memory per device (#22171)

Browse source 
* fit-params : add option to output estimated memory per device

* cont : minor

* cont : refactor

* cont : move fit params implementation to libcommon

* cont : header

* cont : headers

* cont : codeowners
This commit is contained in:
Georgi Gerganov 2026-04-21 09:54:36 +03:00 • committed by GitHub
parent ff6b1062af
commit cfe9838d26
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
19 changed files with 1123 additions and 980 deletions
Download patch file Download diff file Expand all files Collapse all files

3
tools/cli/cli.cpp
View file

@ -2,6 +2,7 @@
#include "common.h"
#include "arg.h"
#include "console.h"
#include "fit.h"
// #include "log.h"
#include "server-common.h"
@ -647,7 +648,7 @@ int main(int argc, char ** argv) {
// bump the log level to display timings
common_log_set_verbosity_thold(LOG_LEVEL_INFO);
llama_memory_breakdown_print(ctx_cli.ctx_server.get_llama_context());
common_memory_breakdown_print(ctx_cli.ctx_server.get_llama_context());
return 0;
}