29 commits

Author	SHA1	Message	Date
Concedo	53bf0fb32d	removed openblas backend, merged into CPU (with llamafile for BLAS). GPU backend is now automatically selected when running from CLI unless noblas is specified.	2024-09-15 19:21:52 +08:00
Concedo	139ab3d198	generate passes whole object now	2024-08-11 00:08:13 +08:00
Concedo	868446bd1a	replace sdconfig and hordeconfig	2024-05-09 22:43:50 +08:00
Concedo	c230b78906	refactored a lot of code, remove bantokens, move it to api	2024-04-27 17:57:13 +08:00
Concedo	6166fdfde4	added support for OAI chat completions adapter file, added default stop sequences to prevent chat compl leakage	2024-04-07 10:35:20 +08:00
Concedo	6c6ad93f01	added basic support for password protection (+2 squashed commit) ... Squashed commit: [ff91ca72] added basic support for password protection [91b0b208] updated docs	2024-03-12 19:47:12 +08:00
Concedo	a69bc44e7a	edit colab (+1 squashed commits) ... Squashed commits: [c7ccb99d] update colab with llava	2024-03-12 15:24:53 +08:00
Concedo	d943c739a8	wip submitting of llava image to backend	2024-03-10 17:14:27 +08:00
Concedo	0c59c1ed90	allow specifying width and height	2024-03-03 15:44:15 +08:00
Concedo	6181b46eef	added nocertify mode	2024-02-19 16:05:17 +08:00
Concedo	4cd571db89	vulkan multigpu, show uptime	2024-02-08 16:54:38 +08:00
Concedo	f81404e33c	updated class py, added imatrix	2024-01-28 22:37:11 +08:00
ebolam	af8503e338	Fix for koboldcpp kobldai model backend. Generate function changed inputs. Passthrough now passes the proper variables. (#641)	2024-01-27 16:31:25 +08:00
Concedo	ba77e916ef	added missing parameters for United class.py	2023-12-28 14:07:26 +08:00
ebolam	6948da5a0d	Fix for windows model unloading not releasing memory (#569) ... * Add in model processes as a separate process so it can be killed when unloading to release memory on windows * Fix from Henky	2023-12-19 15:55:41 +08:00
Concedo	d10470a1e3	Breaking Change: Remove deprecated commands	2023-10-03 17:16:09 +08:00
Concedo	cf31658cbf	added a flag to keep console in foreground	2023-09-27 01:53:30 +08:00
Concedo	17ee719c56	improved remotelink cmd, fixed lib unload, updated class.py	2023-09-25 17:50:00 +08:00
Concedo	2dda63a4eb	add tensor split field	2023-09-20 22:46:47 +08:00
Concedo	712b8423f6	class.py changes	2023-09-20 21:27:49 +08:00
Concedo	951614bfc6	library unloading is working	2023-09-18 15:03:52 +08:00
Concedo	e0fcc9a725	fixed all issues with class.py	2023-09-17 15:23:35 +08:00
Concedo	e107bce105	add another missing field	2023-09-16 23:17:22 +08:00
Concedo	f01a75b563	added missing field	2023-09-16 23:15:44 +08:00
Concedo	733127b160	class.py off by 1	2023-09-16 23:01:12 +08:00
Concedo	8d90072a2a	updated class.py	2023-09-16 18:22:28 +08:00
Concedo	53885de6db	added multiuser mode	2023-09-16 11:23:39 +08:00
Concedo	9d5b4238e8	added config to class.py	2023-08-27 10:32:01 +08:00
Concedo	469d70be45	add support for precompiled binaries, used as a fallback	2023-08-15 13:49:05 +08:00