322 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
chenxl	782a17e4e6	[feature] add bat for windows, update readme	2024-08-09 09:39:42 +00:00
chenht2022	c1cc7d2cd2	1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic.	2024-08-08 09:04:36 +00:00
Atream	1f92f7cc61	[fix] linux and windows can all find CPUInfer in current Directory	2024-08-08 16:02:42 +08:00
UnicornChan	11544ef2b0	Merge pull request #25 from kvcache-ai/windows ... Windows Support	2024-08-08 16:01:54 +08:00
Atream	0e613b602d	[fix] recover fp16 support	2024-08-08 15:42:21 +08:00
chenxl	1d9d397525	fix some bug in compile in linux	2024-08-08 15:34:19 +08:00
Atream	0a2fd52cea	support windows support q4_0 and q5_0 dequant on cpu Add CopyRight from pygguf(It was added before, but disappear after merge). Add some TODO in the code.	2024-08-08 15:34:02 +08:00
UnicornChan	442e13bc97	Merge pull request #18 from UnicornChan/update-docker-readme ... update docker.md to support docker pull image	2024-08-01 15:40:47 +08:00
chenxl	69fa2f4395	update docker.md support docker pull image	2024-08-01 07:39:48 +00:00
UnicornChan	5e83bc0c82	Merge pull request #17 from UnicornChan/feature-support-multi-instruct ... Feature support multi instruct	2024-08-01 12:29:07 +08:00
chenxl	86ba1336a9	[feature] add support for building docker image	2024-08-01 04:01:00 +00:00
chenxl	112cb3c962	[feature] support python 310 and multi instruction	2024-07-31 13:58:17 +00:00
UnicornChan	25620829ce	Merge pull request #14 from UnicornChan/feature-support-pypi ... [feature] support for pypi install	2024-07-29 19:58:18 +08:00
chenxl	dd18a11cab	[feature] support for pypi install	2024-07-29 11:51:28 +00:00
Allen	a25320b703	Update README.md ... update bigcodebench result picture	2024-07-27 23:40:08 +08:00
UnicornChan	8629301b7f	Update README.md ... fix_can't access picture	2024-07-27 23:36:13 +08:00
UnicornChan	de13c3e7cd	Update README.md ... fix can't access picture	2024-07-27 23:27:32 +08:00
UnicornChan	1ac7bfd75e	Update README.md ... fix video can't access	2024-07-27 23:19:49 +08:00
Mingxing Zhang	6977ebb555	Merge pull request #7 from kvcache-ai/james0zan-patch-1 ... Update video	2024-07-27 23:12:59 +08:00
Mingxing Zhang	935c28c277	Update README.md	2024-07-27 23:12:00 +08:00
Mingxing Zhang	01df4a6b3f	Update README.md ... update videos	2024-07-27 23:07:31 +08:00
chenxl	18c42e67df	Initial commit	2024-07-27 16:06:58 +08:00