mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-05-19 16:31:59 +00:00
All C++ handling code currently: - build a comma-separated list from the info_vulkan array - if GGML_VK_VISIBLE_DEVICES isn't set - set GGML_VK_VISIBLE_DEVICES to the list Once set, GGML_VK_VISIBLE_DEVICES affects the whole process. So this can be done in the same way at the Python level, before all loading functions. Caveat: load_model had the default `inputs.vulkan_info = "0"`, so the default GPU would be "0" only when loading a text model. |
||
|---|---|---|
| .. | ||
| acestep | ||
| qwen3tts | ||
| sdcpp | ||
| tools | ||
| ttscpp | ||
| whispercpp | ||
| embeddings_adapter.cpp | ||
| ggml_v1.c | ||
| ggml_v1.h | ||
| ggml_v2-cuda-legacy.cu | ||
| ggml_v2-cuda-legacy.h | ||
| ggml_v2-cuda.cu | ||
| ggml_v2-cuda.h | ||
| ggml_v2.c | ||
| ggml_v2.h | ||
| ggml_v3-cuda.cu | ||
| ggml_v3-cuda.h | ||
| ggml_v3.c | ||
| ggml_v3.h | ||
| gpt2_v1.cpp | ||
| gpt2_v2.cpp | ||
| gpt2_v3.cpp | ||
| gptj_v1.cpp | ||
| gptj_v2.cpp | ||
| gptj_v3.cpp | ||
| llama-util.h | ||
| llama_v2-util.h | ||
| llama_v2.cpp | ||
| llama_v2.h | ||
| llama_v3.cpp | ||
| llama_v3.h | ||
| mpt_v3.cpp | ||
| neox_v2.cpp | ||
| neox_v3.cpp | ||
| otherarch.h | ||
| rwkv_v2.cpp | ||
| rwkv_v2.h | ||
| rwkv_v3.cpp | ||
| rwkv_v3.h | ||
| rwkv_vocab.cpp | ||
| tts_adapter.cpp | ||
| utils.cpp | ||
| utils.h | ||