6 commits

Author	SHA1	Message	Date
Concedo	d5e4cf7ffe	handle ctx manip	2023-06-23 19:01:15 +08:00
Concedo	e6ddb15c3a	cleanup	2023-06-22 10:38:27 +08:00
Concedo	1b71752a9f	Implemented basic GPU offloading for MPT, GPT-2, GPT-J and GPT-NeoX	2023-06-22 00:43:25 +08:00
Concedo	9270056269	fixed compile error in cmake VS	2023-06-05 11:48:04 +08:00
Concedo	c1b293d31a	fixed MPT ooms	2023-06-03 18:37:13 +08:00
Concedo	6f82e17b7a	added MPT support	2023-06-03 16:14:08 +08:00