vrr/prima.cpp
2
0
Fork 0
mirror of https://github.com/Lizonghang/prima.cpp.git synced 2025-09-06 19:39:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
409 commits 6 branches 0 tags 73 MiB
Commit graph

2 commits

Author SHA1 Message Date
Stephan Walter
c1f885067c
ggml : introduce structs for the q4 data blocks (#356) 
* Introduce structs for the q4 data blocks

* ggml : rename quant struct variables + fix ARM_NEON

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-28 18:56:03 +03:00
Stephan Walter
69c92298a9
Deduplicate q4 quantization functions (#383) 
* Deduplicate q4 quantization functions

* Use const; add basic test

* Re-enable quantization test

* Disable AVX2 flags in CI

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-22 19:29:06 +02:00