30 commits

Author	SHA1	Message	Date
Concedo	5ab2fd6118	update classpy	2024-09-15 23:12:49 +08:00
Concedo	53bf0fb32d	removed openblas backend, merged into CPU (with llamafile for BLAS). GPU backend is now automatically selected when running from CLI unless noblas is specified.	2024-09-15 19:21:52 +08:00
Concedo	139ab3d198	generate passes whole object now	2024-08-11 00:08:13 +08:00
Concedo	868446bd1a	replace sdconfig and hordeconfig	2024-05-09 22:43:50 +08:00
Concedo	c230b78906	refactored a lot of code, remove bantokens, move it to api	2024-04-27 17:57:13 +08:00
Concedo	6166fdfde4	added support for OAI chat completions adapter file, added default stop sequences to prevent chat compl leakage	2024-04-07 10:35:20 +08:00
Concedo	6c6ad93f01	added basic support for password protection (+2 squashed commit) ... Squashed commit: [ff91ca72] added basic support for password protection [91b0b208] updated docs	2024-03-12 19:47:12 +08:00
Concedo	a69bc44e7a	edit colab (+1 squashed commits) ... Squashed commits: [c7ccb99d] update colab with llava	2024-03-12 15:24:53 +08:00
Concedo	d943c739a8	wip submitting of llava image to backend	2024-03-10 17:14:27 +08:00
Concedo	0c59c1ed90	allow specifying width and height	2024-03-03 15:44:15 +08:00
Concedo	6181b46eef	added nocertify mode	2024-02-19 16:05:17 +08:00
Concedo	4cd571db89	vulkan multigpu, show uptime	2024-02-08 16:54:38 +08:00
Concedo	f81404e33c	updated class py, added imatrix	2024-01-28 22:37:11 +08:00
ebolam	af8503e338	Fix for koboldcpp kobldai model backend. Generate function changed inputs. Passthrough now passes the proper variables. (#641)	2024-01-27 16:31:25 +08:00
Concedo	ba77e916ef	added missing parameters for United class.py	2023-12-28 14:07:26 +08:00
ebolam	6948da5a0d	Fix for windows model unloading not releasing memory (#569) ... * Add in model processes as a separate process so it can be killed when unloading to release memory on windows * Fix from Henky	2023-12-19 15:55:41 +08:00
Concedo	d10470a1e3	Breaking Change: Remove deprecated commands	2023-10-03 17:16:09 +08:00
Concedo	cf31658cbf	added a flag to keep console in foreground	2023-09-27 01:53:30 +08:00
Concedo	17ee719c56	improved remotelink cmd, fixed lib unload, updated class.py	2023-09-25 17:50:00 +08:00
Concedo	2dda63a4eb	add tensor split field	2023-09-20 22:46:47 +08:00
Concedo	712b8423f6	class.py changes	2023-09-20 21:27:49 +08:00
Concedo	951614bfc6	library unloading is working	2023-09-18 15:03:52 +08:00
Concedo	e0fcc9a725	fixed all issues with class.py	2023-09-17 15:23:35 +08:00
Concedo	e107bce105	add another missing field	2023-09-16 23:17:22 +08:00
Concedo	f01a75b563	added missing field	2023-09-16 23:15:44 +08:00
Concedo	733127b160	class.py off by 1	2023-09-16 23:01:12 +08:00
Concedo	8d90072a2a	updated class.py	2023-09-16 18:22:28 +08:00
Concedo	53885de6db	added multiuser mode	2023-09-16 11:23:39 +08:00
Concedo	9d5b4238e8	added config to class.py	2023-08-27 10:32:01 +08:00
Concedo	469d70be45	add support for precompiled binaries, used as a fallback	2023-08-15 13:49:05 +08:00