9 commits

Author	SHA1	Message	Date
Concedo	1ee5f355d4	try fix some compile issues (+1 squashed commits) ... Squashed commits: [e920e76b] try fix some compile issues	2024-04-08 20:01:46 +08:00
Concedo	125f84aa02	fixed compiler warnings	2024-04-08 16:40:55 +08:00
Concedo	acb792815e	try fix cuda slowdown	2024-02-05 16:34:15 +08:00
Concedo	a137b6b9ff	fixed typo	2024-01-20 17:28:14 +08:00
Concedo	680a41ed71	refactor identifiers	2024-01-20 17:26:11 +08:00
Concedo	693f3f0b00	try to use allocator for cuda ggml v3	2024-01-20 12:53:31 +08:00
Concedo	97693e7e97	increase pool buffers	2024-01-20 11:52:39 +08:00
Concedo	21f0ce2502	do not use vmm for ggml v3	2024-01-20 11:30:22 +08:00
Concedo	db14de5c32	fossilize ggml library ver 3, to support ggjtv3	2024-01-20 10:49:25 +08:00