koboldcpp/ggml
WakeUpMorty df750f76bb
vulkan: add dedicated iq4_xs mat-vec shader (#28426)
* vulkan: add dedicated iq4_xs mat-vec shader

Dedicated mul_mat_vec_iq4_xs for the dmmv path, replacing the generic fallback. ~+6-17% token generation on RDNA4 depending on model.

Assisted-by: Pi agent with Qwen3.8 27B

* vulkan iq4_xs: remove dead n_it unroll branch

Remove the n_it <= 8 experimental branch that attempted to fully unroll
the block loop. Since n_it is a runtime value, [[unroll]] is ignored by
the compiler, making both branches equivalent. Kept the simple loop
matching mul_mat_vec_iq3_s.comp.
2026-09-09 09:26:36 +03:00
..
cmake kleidiai: Rework KleidiAI Build System/Integration (#26077) 2026-08-25 14:07:29 -07:00
include ggml : update ggml_prec specification (#26675) 2026-09-08 09:06:24 +03:00
src vulkan: add dedicated iq4_xs mat-vec shader (#28426) 2026-09-09 09:26:36 +03:00
.gitignore vulkan : cmake integration (#8119) 2024-07-13 18:12:39 +02:00
CMakeLists.txt sync : ggml (#28379) 2026-09-04 14:39:19 +03:00