8 commits

Author	SHA1	Message	Date
Concedo	417711be46	add more QOL	2023-05-17 00:11:28 +08:00
Concedo	954b87eb05	working checkpoint	2023-05-16 22:33:21 +08:00
Concedo	8e394f9913	progress	2023-05-16 17:29:55 +08:00
Concedo	e05455f852	fixed wrong sized struct from legacy q8_1, fixed opencl varsize arrays	2023-05-13 23:56:08 +08:00
Concedo	05cf5f7d6e	partially working, but the blas matmul is broken	2023-05-13 11:35:38 +08:00
Concedo	b335f73a60	BACKWARDS COMPAT QUANT SHIM is ready, but upstream model converter is BORKED. BORK BORK.	2023-05-13 01:30:11 +08:00
Concedo	08810d5fee	interim merge. do not use	2023-05-13 00:33:55 +08:00
Concedo	e9caff1cda	Interim merge. Do not use. ... Merge branch 'master' into concedo_experimental # Conflicts: # README.md # SHA256SUMS # examples/quantize/quantize.cpp # ggml-opencl.c # ggml.c # ggml.h # llama.cpp # llama.h	2023-05-12 23:20:27 +08:00