11 commits

Author	SHA1	Message	Date
Concedo	5925c23d51	fix for RWKV	2023-09-01 17:02:11 +08:00
Concedo	b8372d4466	Merge branch 'master' into concedo_experimental ... # Conflicts: # .gitignore # README.md # tests/CMakeLists.txt	2023-08-24 15:21:24 +08:00
Concedo	523fc3be52	fixed rwkv, standardized new ctx usage	2023-07-10 20:05:53 +08:00
Concedo	2827920044	fix compile errors, rwkv not working	2023-07-10 18:23:25 +08:00
Concedo	ca9a11697c	possibly slower, but cannot use larger batches without modifying ggml library.	2023-07-04 00:35:02 +08:00
Concedo	ef3b8dc0d9	GPU accel for rwkv is slow, disable it	2023-07-02 00:41:46 +08:00
Concedo	e1a7042943	try out the new rwkv but it seems worse, may revert	2023-07-02 00:10:56 +08:00
Concedo	3ed3e7b7e2	reverted sequence mode for rwkv due to multiple issues with speed loss with bigger quantized models	2023-06-14 20:03:14 +08:00
Concedo	860fb026df	rwkv compile fix (+1 squashed commits) ... Squashed commits: [8b0ebb1] upgraded rwkv + added memory overheads + added state_out bufs	2023-06-12 23:04:40 +08:00
Concedo	97b39f875c	fixed fstat64 build error on mac	2023-05-29 15:50:07 +08:00
Concedo	55e0fbf024	wip integrating new rwkv	2023-05-27 22:45:28 +08:00