4146 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Lizonghang	2fbc0c8da3	fix: reset -ngl to 0 when GPU is not used and reformat code	2025-05-14 13:27:20 +04:00
Li, Zonghang	b44187e3af	Merge pull request #9 from yezhizi/rm-profile ... Remove unnecessary profiling when `-lw` is specified	2025-05-14 10:05:49 +08:00
Li, Zonghang	ca95b1efad	Merge pull request #11 from eltociear/patch-1 ... chore: update debug-test.sh	2025-04-22 00:32:19 +08:00
Ikko Eltociear Ashimine	fa1444ab3b	chore: update debug-test.sh ... compliation -> compilation	2025-04-21 23:40:40 +09:00
DeEMO	cf4fa04980	Add an independent profile tool	2025-04-18 03:27:20 +00:00
DeEMO	168c14f4e8	remove unnecessary profile when --lw is specified	2025-04-17 13:49:09 +00:00
DeEMO	9cb87f7923	add fio file to gitignore	2025-04-17 13:44:23 +00:00
leeetao	fc1e2d3fc6	Added support for iq1s and iq1m quantization type	2025-04-17 10:27:53 +00:00
leeetao	b212d74dc3	update Readme.md	2025-04-17 09:17:11 +00:00
Zonghang Li	f9702ec4c0	update README.md	2025-04-16 15:55:43 +04:00
Zonghang Li	5a5f103833	fix q6k and q80	2025-04-16 08:55:07 +04:00
Li, Zonghang	b59d6d9cdf	Update README.md	2025-04-15 09:59:08 +08:00
Li, Zonghang	6d13836c44	Update README.md	2025-04-11 01:41:43 +08:00
Li, Zonghang	4845abf25e	Update README.md	2025-04-11 01:20:36 +08:00
Li, Zonghang	4ab9087d69	Update LICENSE	2025-04-09 21:42:55 +08:00
Lizonghang	e48b804730	update README.md	2025-04-09 13:55:30 +04:00
Li, Zonghang	55f8dc588f	Update README.md	2025-04-09 10:56:25 +08:00
Lizonghang	e421d788d3	update README	2025-04-08 23:15:43 +04:00
Lizonghang	03ff9a7654	update README	2025-04-07 23:28:01 +04:00
Li, Zonghang	a3a1f4499b	Update README.md	2025-04-07 22:14:44 +08:00
Li, Zonghang	98d73778a6	Update README.md	2025-04-07 22:13:31 +08:00
Li, Zonghang	5984b1b75f	Update README.md	2025-04-07 22:13:12 +08:00
Li, Zonghang	ebd15b4112	Update README.md	2025-04-07 22:12:11 +08:00
Li, Zonghang	35adc76337	Update README.md	2025-04-07 22:08:14 +08:00
Lizonghang	87eb1aa7ec	update README	2025-04-07 18:06:57 +04:00
Li, Zonghang	67b10034a7	update video to compare llama.cpp and prima.cpp	2025-04-07 18:01:04 +04:00
Lizonghang	7631ddcdc7	ignore video	2025-04-07 17:59:23 +04:00
Lizonghang	fffefb9259	update README	2025-04-07 17:57:57 +04:00
Lizonghang	f97a97003b	fix type convert	2025-04-07 17:57:50 +04:00
Lizonghang	3b264352e7	update README	2025-03-30 23:39:36 +04:00
Lizonghang	3a6cb1768f	add logo	2025-03-30 17:21:42 +04:00
Zonghang Li	63b45a4c26	add args -k and --force	2025-03-11 22:09:39 +04:00
Zonghang Li	bcfdace59b	add args -k and --force	2025-03-11 20:44:36 +04:00
leeetao	45ec52c2cb	Added support for IQ1_M and IQ2_XXS quantization type	2025-03-07 16:56:16 +00:00
leeetao	230c68b80c	fixed the alignment display	2025-03-07 07:55:23 +00:00
leeetao	6a416534c8	Fixed the alignment display of device performance	2025-03-07 07:46:30 +00:00
leeetao	54c4c1c26e	Fixed the flops test for iq1s and q2k quantization types	2025-03-07 02:47:00 +00:00
leeetao	2f049b8428	Added support for Q2K, IQ1s, IQ4NL quantization types	2025-03-04 15:22:55 +00:00
leeetao	e2cda4cfa0	Removed support for GGML_TYPE_Q4_0_4_4, GGML_TYPE_0_4_8, and GGML_TYPE_0_8_8 (GGUF no longer supports these types)	2025-03-01 14:31:38 +00:00
Lizonghang	9cbdf01645	fix support for Q5_0	2025-02-27 22:25:03 +04:00
Lizonghang	c8e615d69c	fix n_m bound error	2025-02-27 21:59:04 +04:00
Lizonghang	550fdcbc4f	add support for Q5_0	2025-02-27 21:47:14 +04:00
Lizonghang	96e68679ce	fix upper bound and set calibration in halda	2025-02-27 17:00:27 +04:00
Lizonghang	41f3708999	fix condition for gpu overload	2025-02-25 21:31:55 +04:00
leeetao	224d14eb4c	Merge branch 'tao' into dev	2025-02-24 16:48:43 +00:00
leeetao	42da179d66	Added parameter display for the distilled model of deepseek-qwen	2025-02-24 13:24:56 +00:00
Lizonghang	e3a0d0007a	add gpu check in set calibration	2025-02-23 21:56:59 +04:00
leeetao	7bf1b743fb	Merge branch 'dev' into lt_test ... Merge dev branch updates into local branch lt_test.	2025-02-23 08:35:45 +00:00
leeetao	b4a9932d56	Added deepseek-r1-qwen vocabulary file	2025-02-23 08:33:57 +00:00
leeetao	f99e08b9fe	Added inference support for the Deepseek distilled model	2025-02-23 08:27:37 +00:00