41 commits

Author	SHA1	Message	Date
Concedo	7a7bdeab6d	json to gbnf endpoint added	2025-04-12 11:41:11 +08:00
Concedo	782e1e193a	replaced winclinfo.exe with a simplified simpleclinfo.exe that only provides device names and nothing else (+1 squashed commits) ... Squashed commits: [4a73c8d3] replaced winclinfo.exe with a simplified simpleclinfo.exe that only provides device names and nothing else	2025-03-14 18:18:32 +08:00
Concedo	7a5499e77b	added one more backend for clblast noavx2 and clblast failsafe	2025-01-30 22:47:22 +08:00
Concedo	bf4a52383f	change of plans, we can't bundle numpy	2025-01-19 22:53:38 +08:00
Concedo	fa7e661133	various fixes	2025-01-18 23:52:39 +08:00
Concedo	3732bb2686	taesd now supports flux and sd3	2025-01-08 22:35:50 +08:00
Concedo	6bd686c8a8	fix pyinstaller for windows	2024-11-25 23:20:23 +08:00
Concedo	afc575fbd8	cleanup, try to add version tagging	2024-11-23 12:59:06 +08:00
Concedo	53bf0fb32d	removed openblas backend, merged into CPU (with llamafile for BLAS). GPU backend is now automatically selected when running from CLI unless noblas is specified.	2024-09-15 19:21:52 +08:00
Concedo	066e7ac540	minor fixes: colab gpu backend, lite bugs, package python file with embd	2024-07-15 17:36:03 +08:00
Concedo	11f0643fa4	fix pyinstallers	2024-06-27 15:19:44 +08:00
Nexesenex	1074e6f924	Add psutil in building batches (#862)	2024-05-24 16:19:25 +08:00
Concedo	5ce2fdad24	taesd for sdxl, add lora loading done	2024-05-14 23:02:56 +08:00
Concedo	5d15f8f76a	vae test	2024-05-14 19:17:01 +08:00
Concedo	3667cc0113	fixed stableui btn (+4 squashed commit) ... Squashed commit: [1d4714f1] update default amount to gen [6eacba33] updated lite [033589af] added first ver sdui [16f66d57] updated lite	2024-05-06 00:55:16 +08:00
Concedo	a5fbf49a97	added cuda kcpp build steps	2024-04-11 23:45:32 +08:00
Concedo	f3a0e05d91	added noavx2 vulkan	2024-02-22 16:56:25 +08:00
Concedo	79b73e28b2	update pyinstallers	2024-01-25 23:53:46 +08:00
Concedo	e08e1bdc68	include opencl dll	2023-11-11 10:05:42 +08:00
Concedo	fca7a4c054	added noavx2 model for clblast (+1 squashed commits) ... Squashed commits: [291ecae6] added noavx2 mode for clblast (+1 squashed commits) Squashed commits: [562bc872] wip adding noavx2 cl	2023-11-02 15:22:34 +08:00
Concedo	82267e5e69	switched back to clinfo since it's possibly more cross platform and can get memory vals easily	2023-11-02 14:12:05 +08:00
Concedo	92d80b94b3	bundle simpleclinfo into pyinstaller except for linux	2023-11-01 18:26:15 +08:00
Concedo	b4b5c35074	add documentation for koboldcpp	2023-10-05 21:17:36 +08:00
Concedo	dae9dffa6a	rename koboldcpp.dll to koboldcpp_default.dll	2023-08-11 14:54:27 +08:00
Concedo	45456fa6ca	switch noavx2 to not use openblas, as it has incompatible instructions	2023-07-30 16:47:33 +08:00
Concedo	a689a66068	make it work with pyinstaller	2023-07-07 17:52:34 +08:00
Concedo	6119b8a3d0	new vocab files	2023-06-13 22:22:04 +08:00
Concedo	cd4012c3ed	minor fixes to debug logging, fixed a typo, added a new failsafe mode	2023-05-23 21:31:42 +08:00
Concedo	811989c2ad	fixed pyinstaller	2023-04-22 16:31:42 +08:00
Concedo	346cd68903	make linux and OSX build process equal to windows. Now it will build all applicable libraries, for a full build do make LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1	2023-04-20 15:53:55 +08:00
Concedo	a76b15b581	Merge branch 'concedo' into concedo_experimental ... # Conflicts: # make_pyinstaller.bat	2023-04-18 17:42:43 +08:00
Gustavo Rocha Dias	a9253cdfba	fix - at some OSs the PyInstaller command is case sensitive, at lowercase it doen't work. (#81)	2023-04-18 17:39:06 +08:00
Concedo	c200b674f4	updated kobold lite, work on rwkv, added exe path to model load params, added launch parameter	2023-04-18 17:36:44 +08:00
Concedo	1bd5992da4	clean and refactor handling of flags	2023-04-12 23:25:31 +08:00
Concedo	4faae0afa9	Merged upstream, fixed OSX compile errors, integrated noavx2 build into main	2023-04-12 18:08:55 +08:00
Concedo	23c675b2e6	integrated optional (experimentl) CLBlast support	2023-04-11 23:33:44 +08:00
Concedo	eb5b22dda2	rebrand to koboldcpp	2023-04-03 10:35:18 +08:00
Concedo	6e6125ebdb	updated pyinstaller to clean temp dir,removed warning flags from makefile because they are just clutter.	2023-04-01 09:25:41 +08:00
Concedo	d8febc8653	renamed main python script	2023-03-30 00:48:44 +08:00
Concedo	664b277c27	integrated libopenblas for greatly accelerated prompt processing. Windows binaries are included - feel free to build your own or to build for other platforms, but that is beyond the scope of this repo. Will fall back to non-blas if libopenblas is removed.	2023-03-30 00:43:52 +08:00
Concedo	e791827973	added a GUI for selection of models if none was passed in through command line.	2023-03-24 22:03:57 +08:00