4 commits

Author	SHA1	Message	Date
Concedo	90fe9096b4	clean and refactoring pass before supporting newer models for different arch	2023-05-17 11:23:29 +08:00
Concedo	3de34ee492	Merge branch 'master' into concedo_experimental ... # Conflicts: # CMakeLists.txt # Makefile # ggml-opencl.c	2023-05-01 12:03:46 +08:00
Concedo	032a171867	integrated q5 formats	2023-04-28 12:58:39 +08:00
Concedo	59fb174678	fixed compile errors, made mmap automatic when lora is selected, added updated quantizers and quantization handling for gpt neox gpt 2 and gptj	2023-04-24 23:20:06 +08:00