33 commits

Author	SHA1	Message	Date
Concedo	53bf0fb32d	removed openblas backend, merged into CPU (with llamafile for BLAS). GPU backend is now automatically selected when running from CLI unless noblas is specified.	2024-09-15 19:21:52 +08:00
Concedo	066e7ac540	minor fixes: colab gpu backend, lite bugs, package python file with embd	2024-07-15 17:36:03 +08:00
Concedo	11f0643fa4	fix pyinstallers	2024-06-27 15:19:44 +08:00
Nexesenex	1074e6f924	Add psutil in building batches (#862)	2024-05-24 16:19:25 +08:00
Concedo	5ce2fdad24	taesd for sdxl, add lora loading done	2024-05-14 23:02:56 +08:00
Concedo	5d15f8f76a	vae test	2024-05-14 19:17:01 +08:00
Concedo	3667cc0113	fixed stableui btn (+4 squashed commit) ... Squashed commit: [1d4714f1] update default amount to gen [6eacba33] updated lite [033589af] added first ver sdui [16f66d57] updated lite	2024-05-06 00:55:16 +08:00
Concedo	a5fbf49a97	added cuda kcpp build steps	2024-04-11 23:45:32 +08:00
Concedo	f3a0e05d91	added noavx2 vulkan	2024-02-22 16:56:25 +08:00
Concedo	79b73e28b2	update pyinstallers	2024-01-25 23:53:46 +08:00
Concedo	e08e1bdc68	include opencl dll	2023-11-11 10:05:42 +08:00
Concedo	fca7a4c054	added noavx2 model for clblast (+1 squashed commits) ... Squashed commits: [291ecae6] added noavx2 mode for clblast (+1 squashed commits) Squashed commits: [562bc872] wip adding noavx2 cl	2023-11-02 15:22:34 +08:00
Concedo	82267e5e69	switched back to clinfo since it's possibly more cross platform and can get memory vals easily	2023-11-02 14:12:05 +08:00
Concedo	92d80b94b3	bundle simpleclinfo into pyinstaller except for linux	2023-11-01 18:26:15 +08:00
Concedo	b4b5c35074	add documentation for koboldcpp	2023-10-05 21:17:36 +08:00
Concedo	dae9dffa6a	rename koboldcpp.dll to koboldcpp_default.dll	2023-08-11 14:54:27 +08:00
Concedo	45456fa6ca	switch noavx2 to not use openblas, as it has incompatible instructions	2023-07-30 16:47:33 +08:00
Concedo	a689a66068	make it work with pyinstaller	2023-07-07 17:52:34 +08:00
Concedo	6119b8a3d0	new vocab files	2023-06-13 22:22:04 +08:00
Concedo	cd4012c3ed	minor fixes to debug logging, fixed a typo, added a new failsafe mode	2023-05-23 21:31:42 +08:00
Concedo	811989c2ad	fixed pyinstaller	2023-04-22 16:31:42 +08:00
Concedo	346cd68903	make linux and OSX build process equal to windows. Now it will build all applicable libraries, for a full build do make LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1	2023-04-20 15:53:55 +08:00
Concedo	a76b15b581	Merge branch 'concedo' into concedo_experimental ... # Conflicts: # make_pyinstaller.bat	2023-04-18 17:42:43 +08:00
Gustavo Rocha Dias	a9253cdfba	fix - at some OSs the PyInstaller command is case sensitive, at lowercase it doen't work. (#81)	2023-04-18 17:39:06 +08:00
Concedo	c200b674f4	updated kobold lite, work on rwkv, added exe path to model load params, added launch parameter	2023-04-18 17:36:44 +08:00
Concedo	1bd5992da4	clean and refactor handling of flags	2023-04-12 23:25:31 +08:00
Concedo	4faae0afa9	Merged upstream, fixed OSX compile errors, integrated noavx2 build into main	2023-04-12 18:08:55 +08:00
Concedo	23c675b2e6	integrated optional (experimentl) CLBlast support	2023-04-11 23:33:44 +08:00
Concedo	eb5b22dda2	rebrand to koboldcpp	2023-04-03 10:35:18 +08:00
Concedo	6e6125ebdb	updated pyinstaller to clean temp dir,removed warning flags from makefile because they are just clutter.	2023-04-01 09:25:41 +08:00
Concedo	d8febc8653	renamed main python script	2023-03-30 00:48:44 +08:00
Concedo	664b277c27	integrated libopenblas for greatly accelerated prompt processing. Windows binaries are included - feel free to build your own or to build for other platforms, but that is beyond the scope of this repo. Will fall back to non-blas if libopenblas is removed.	2023-03-30 00:43:52 +08:00
Concedo	e791827973	added a GUI for selection of models if none was passed in through command line.	2023-03-24 22:03:57 +08:00