Georgi Gerganov d5ac8cf2f2 ggml : add metal backend registry / device (#9713) ... * ggml : add metal backend registry / device ggml-ci * metal : fix names [no ci] * metal : global registry and device instances ggml-ci * cont : alternative initialization of global objects ggml-ci * llama : adapt to backend changes ggml-ci * fixes * metal : fix indent * metal : fix build when MTLGPUFamilyApple3 is not available ggml-ci * fix merge * metal : avoid unnecessary singleton accesses ggml-ci * metal : minor fix [no ci] * metal : g_state -> g_ggml_ctx_dev_main [no ci] * metal : avoid reference of device context in the backend context ggml-ci * metal : minor [no ci] * metal : fix maxTransferRate check * metal : remove transfer rate stuff --------- Co-authored-by: slaren <slarengh@gmail.com>		2024-10-07 18:27:51 +03:00
..
ggml-cann	cann: fix crash when llama-bench is running on multiple cann devices (#9627)	2024-09-25 11:30:38 +08:00
ggml-cuda	ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980)	2024-10-03 21:17:26 +03:00
ggml-sycl	Fixed dequant precision issues in Q4_1 and Q5_1 (#9711)	2024-10-03 07:50:44 +01:00
kompute@4565194ed7	llama : reorganize source code + improve CMake (#8006)	2024-06-26 18:33:02 +03:00
kompute-shaders	ggml : move rope type enum to ggml.h (#8949)	2024-08-13 21:13:15 +02:00
llamafile	ggml : move common CPU backend impl to new header (#9509)	2024-09-16 16:22:07 +02:00
vulkan-shaders	vulkan : argsort barriers must be under uniform control flow (ggml/951)	2024-09-29 21:15:37 +03:00
CMakeLists.txt	ggml-backend : add device and backend reg interfaces (#9707)	2024-10-03 01:49:47 +02:00
ggml-aarch64.c	ggml : add run-time detection of neon, i8mm and sve (#9331)	2024-09-28 15:06:16 +03:00
ggml-aarch64.h	ggml : minor naming changes (#8433)	2024-07-12 10:46:02 +03:00
ggml-alloc.c	ggml-alloc : fix list of allocated tensors with GGML_ALLOCATOR_DEBUG (#9573)	2024-09-21 14:24:23 +02:00
ggml-backend-impl.h	ggml: unify backend logging mechanism (#9709)	2024-10-03 17:39:03 +02:00
ggml-backend.cpp	ggml : add metal backend registry / device (#9713)	2024-10-07 18:27:51 +03:00
ggml-blas.cpp	ggml-backend : add device and backend reg interfaces (#9707)	2024-10-03 01:49:47 +02:00
ggml-cann.cpp	ggml: unify backend logging mechanism (#9709)	2024-10-03 17:39:03 +02:00
ggml-common.h	ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)	2024-09-05 21:48:47 -04:00
ggml-cpu-impl.h	ggml : move common CPU backend impl to new header (#9509)	2024-09-16 16:22:07 +02:00
ggml-cuda.cu	ggml : add metal backend registry / device (#9713)	2024-10-07 18:27:51 +03:00
ggml-impl.h	ggml: unify backend logging mechanism (#9709)	2024-10-03 17:39:03 +02:00
ggml-kompute.cpp	ggml-backend : add device and backend reg interfaces (#9707)	2024-10-03 01:49:47 +02:00
ggml-metal.m	ggml : add metal backend registry / device (#9713)	2024-10-07 18:27:51 +03:00
ggml-metal.metal	metal : use F32 prec for K*Q in vec FA (#9595)	2024-09-23 11:27:47 +03:00
ggml-quants.c	ggml : add run-time detection of neon, i8mm and sve (#9331)	2024-09-28 15:06:16 +03:00
ggml-quants.h	ggml : add run-time detection of neon, i8mm and sve (#9331)	2024-09-28 15:06:16 +03:00
ggml-rpc.cpp	ggml-backend : add device and backend reg interfaces (#9707)	2024-10-03 01:49:47 +02:00
ggml-sycl.cpp	ggml-backend : add device and backend reg interfaces (#9707)	2024-10-03 01:49:47 +02:00
ggml-vulkan.cpp	vulkan : retry allocation with fallback flags (whisper/2451)	2024-10-06 12:52:11 +03:00
ggml.c	ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980)	2024-10-03 21:17:26 +03:00