vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-07 23:45:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

opencl: limit local workgroup size for GLU operation (#26383)

Browse source
This commit is contained in:
mgroeber9110 2026-08-02 20:44:00 +02:00 • committed by GitHub
parent fffbcbdb9d
commit 0ab9d6fed7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
ggml/src/ggml-opencl/ggml-opencl.cpp
View file

@ -24260,7 +24260,7 @@ static void ggml_cl_glu(ggml_backend_t backend, const ggml_tensor * src0, const
}
const size_t nrows = ggml_nrows(src0);
size_t nth = 512;
size_t nth = backend_ctx->max_workgroup_size < 512 ? backend_ctx->max_workgroup_size : 512;
size_t global_work_size[] = {nrows*nth, 1, 1};
size_t local_work_size[] = {nth, 1, 1};