1085 commits

Author	SHA1	Message	Date
Concedo	94dc5c2324	allow 2048 blasbatchsize	2023-05-27 17:47:18 +08:00
Concedo	abfdfb702e	added top_a sampler	2023-05-27 17:32:37 +08:00
Concedo	bd4fe936f5	cleanup sampling code	2023-05-27 11:58:39 +08:00
Concedo	8b8f2f4cf5	up ver to 1.25.1	2023-05-25 14:49:30 +08:00
Concedo	37a34deaa0	added a second pyinstaller for my own use that uses a different python version. don't use this.	2023-05-24 23:34:11 +08:00
Concedo	d04b3bbe5e	disable mmap when failsafe mode selected from GUI	2023-05-24 15:04:17 +08:00
Concedo	355007b019	added sampler seed	2023-05-23 21:52:26 +08:00
Concedo	cd4012c3ed	minor fixes to debug logging, fixed a typo, added a new failsafe mode	2023-05-23 21:31:42 +08:00
Concedo	587308a202	fixed some build errors on linux, changed icon resolution, added more error printing	2023-05-22 12:18:42 +08:00
Concedo	24127ebf98	updated lite, fixed some encoding issues	2023-05-21 17:29:00 +08:00
Concedo	c048bcfec4	remove old filever checks (+7 squashed commit) ... Squashed commit: [b72627a] new format not working [e568870] old ver works [7053b77] compile errors fixed, fixing linkers [4ae8889] add new ver [ff82dfd] file format checks [25b8aa8] refactoring type names [931063b] still merging	2023-05-21 00:15:39 +08:00
Concedo	f5e1fe46e1	up ver	2023-05-18 17:15:03 +08:00
Concedo	76dc539172	change help text	2023-05-17 18:06:47 +08:00
Concedo	e4e6994353	Not working, don't use. testing a merge	2023-05-16 12:33:24 +08:00
Concedo	fce2e7e518	up version	2023-05-15 14:53:13 +08:00
Concedo	466cd21368	test cmakefile for cublas.	2023-05-15 14:50:38 +08:00
Concedo	9cd5b9a769	up ver	2023-05-14 11:10:26 +08:00
Concedo	e05455f852	fixed wrong sized struct from legacy q8_1, fixed opencl varsize arrays	2023-05-13 23:56:08 +08:00
Concedo	b6594ab91e	do not show tokenizer warning	2023-05-13 15:48:17 +08:00
Concedo	6d87f67572	up ver	2023-05-09 17:25:46 +08:00
Concedo	b9904c3093	up ver	2023-05-08 11:13:16 +08:00
Concedo	89d70886a4	added support for setting custom context size at load time (memory allocation)	2023-05-08 11:11:25 +08:00
Concedo	ff93b394da	fixed a typo	2023-05-06 12:37:34 +08:00
Concedo	8a964e76c8	integrated mirostat as a launch parameter, works on all models	2023-05-06 00:47:17 +08:00
Concedo	851f55325a	Merge remote-tracking branch 'temp/concedo' into concedo_experimental	2023-05-05 23:55:53 +08:00
Concedo	2edbcebe27	added optional force versioning flag	2023-05-05 22:02:00 +08:00
Hendrik Langer	8131bc8b56	add new sampling algorithm mirostat	2023-05-05 13:23:47 +02:00
Concedo	4857739ab5	allow specifying a different thread count for GPU blas	2023-05-03 21:19:59 +08:00
Concedo	89044502fe	just use RT	2023-05-03 11:07:36 +08:00
Concedo	f43a63235b	priority adjustment for linux fixed	2023-05-03 10:16:43 +08:00
Concedo	966cd2ce91	Merge remote-tracking branch 'temp/concedo' into concedo_experimental ... # Conflicts: # koboldcpp.py	2023-05-02 22:43:34 +08:00
Concedo	58f25dce86	added flag to increase processs priority	2023-05-02 22:26:55 +08:00
Sergey Kucher	069b3d4c37	Adds --mlock argument	2023-05-02 16:19:37 +03:00
Concedo	5a10ea50da	up ver	2023-05-02 18:19:08 +08:00
Concedo	6f702f2700	fixed stop sequence crash	2023-05-02 14:56:50 +08:00
Concedo	433fa1e8b2	fix for stop sequence missing, added print for exception when loading GUI	2023-05-02 14:18:04 +08:00
Concedo	4d38795563	add UI for token unbanning	2023-05-01 12:10:21 +08:00
Concedo	f149114395	up ver	2023-04-29 19:42:21 +08:00
Concedo	7afad2b9b5	integrated the new samplers	2023-04-29 19:41:41 +08:00
Concedo	67ee2b93a7	removed bad import.	2023-04-29 09:59:16 +08:00
Concedo	f75de52b25	add short delay before exit gui	2023-04-28 15:09:17 +08:00
Concedo	e97c7099b0	created new tkinter GUI	2023-04-28 15:03:48 +08:00
Concedo	e8a389f85b	updated kobold lite, added debug mode, changed streaming mode to now use the same url when launching	2023-04-28 11:41:03 +08:00
Concedo	2499632cdc	up version	2023-04-27 17:27:10 +08:00
Concedo	137efe2b8f	updated embedded kobold lite, force streaming mode if stream flag is used	2023-04-27 17:16:55 +08:00
Concedo	5eec5d6ed9	Added backwards compatibility to an earlier version of NeoX.	2023-04-25 20:34:18 +08:00
Concedo	bff998f871	Slight refactor of the python code: credits to @LuxF3rre	2023-04-25 19:20:14 +08:00
Concedo	59fb174678	fixed compile errors, made mmap automatic when lora is selected, added updated quantizers and quantization handling for gpt neox gpt 2 and gptj	2023-04-24 23:20:06 +08:00
Concedo	3962eb39c7	added token unbanning	2023-04-24 21:50:20 +08:00
Concedo	8e615c8245	Merge branch 'master' into concedo_experimental ... # Conflicts: # README.md	2023-04-24 12:20:08 +08:00