vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-05 22:59:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3222 commits 3 branches 196 tags 374 MiB
Commit graph

2 commits

Author SHA1 Message Date
0cc4m
45c0e2e4c1
Refactor Vulkan backend to allow multiple contexts (#7961) 
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
 2024-06-23 10:21:25 +02:00
0cc4m
7c7836d9d4
Vulkan Shader Refactor, Memory Debugging Option (#7947) 
* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use
 2024-06-16 07:17:31 +02:00