vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-10 17:14:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
2321 commits 3 branches 196 tags 386 MiB
Commit graph

281 commits

Author SHA1 Message Date
Concedo
37a34deaa0 added a second pyinstaller for my own use that uses a different python version. don't use this. 2023-05-24 23:34:11 +08:00
Concedo
d04b3bbe5e disable mmap when failsafe mode selected from GUI 2023-05-24 15:04:17 +08:00
Concedo
355007b019 added sampler seed 2023-05-23 21:52:26 +08:00
Concedo
cd4012c3ed minor fixes to debug logging, fixed a typo, added a new failsafe mode 2023-05-23 21:31:42 +08:00
Concedo
587308a202 fixed some build errors on linux, changed icon resolution, added more error printing 2023-05-22 12:18:42 +08:00
Concedo
24127ebf98 updated lite, fixed some encoding issues 2023-05-21 17:29:00 +08:00
Concedo
c048bcfec4 remove old filever checks (+7 squashed commit) 
Squashed commit:

[b72627a] new format not working

[e568870] old ver works

[7053b77] compile errors fixed, fixing linkers

[4ae8889] add new ver

[ff82dfd] file format checks

[25b8aa8] refactoring type names

[931063b] still merging
 2023-05-21 00:15:39 +08:00
Concedo
f5e1fe46e1 up ver 2023-05-18 17:15:03 +08:00
Concedo
76dc539172 change help text 2023-05-17 18:06:47 +08:00
Concedo
e4e6994353 Not working, don't use. testing a merge 2023-05-16 12:33:24 +08:00
Concedo
fce2e7e518 up version 2023-05-15 14:53:13 +08:00
Concedo
466cd21368 test cmakefile for cublas. 2023-05-15 14:50:38 +08:00
Concedo
9cd5b9a769 up ver 2023-05-14 11:10:26 +08:00
Concedo
e05455f852 fixed wrong sized struct from legacy q8_1, fixed opencl varsize arrays 2023-05-13 23:56:08 +08:00
Concedo
b6594ab91e do not show tokenizer warning 2023-05-13 15:48:17 +08:00
Concedo
6d87f67572 up ver 2023-05-09 17:25:46 +08:00
Concedo
b9904c3093 up ver 2023-05-08 11:13:16 +08:00
Concedo
89d70886a4 added support for setting custom context size at load time (memory allocation) 2023-05-08 11:11:25 +08:00
Concedo
ff93b394da fixed a typo 2023-05-06 12:37:34 +08:00
Concedo
8a964e76c8 integrated mirostat as a launch parameter, works on all models 2023-05-06 00:47:17 +08:00
Concedo
851f55325a Merge remote-tracking branch 'temp/concedo' into concedo_experimental 2023-05-05 23:55:53 +08:00
Concedo
2edbcebe27 added optional force versioning flag 2023-05-05 22:02:00 +08:00
Hendrik Langer
8131bc8b56 add new sampling algorithm mirostat 2023-05-05 13:23:47 +02:00
Concedo
4857739ab5 allow specifying a different thread count for GPU blas 2023-05-03 21:19:59 +08:00
Concedo
89044502fe just use RT 2023-05-03 11:07:36 +08:00
Concedo
f43a63235b priority adjustment for linux fixed 2023-05-03 10:16:43 +08:00
Concedo
966cd2ce91 Merge remote-tracking branch 'temp/concedo' into concedo_experimental 
# Conflicts:
#	koboldcpp.py
 2023-05-02 22:43:34 +08:00
Concedo
58f25dce86 added flag to increase processs priority 2023-05-02 22:26:55 +08:00
Sergey Kucher
069b3d4c37 Adds --mlock argument 2023-05-02 16:19:37 +03:00
Concedo
5a10ea50da up ver 2023-05-02 18:19:08 +08:00
Concedo
6f702f2700 fixed stop sequence crash 2023-05-02 14:56:50 +08:00
Concedo
433fa1e8b2 fix for stop sequence missing, added print for exception when loading GUI 2023-05-02 14:18:04 +08:00
Concedo
4d38795563 add UI for token unbanning 2023-05-01 12:10:21 +08:00
Concedo
f149114395 up ver 2023-04-29 19:42:21 +08:00
Concedo
7afad2b9b5 integrated the new samplers 2023-04-29 19:41:41 +08:00
Concedo
67ee2b93a7 removed bad import. 2023-04-29 09:59:16 +08:00
Concedo
f75de52b25 add short delay before exit gui 2023-04-28 15:09:17 +08:00
Concedo
e97c7099b0 created new tkinter GUI 2023-04-28 15:03:48 +08:00
Concedo
e8a389f85b updated kobold lite, added debug mode, changed streaming mode to now use the same url when launching 2023-04-28 11:41:03 +08:00
Concedo
2499632cdc up version 2023-04-27 17:27:10 +08:00
Concedo
137efe2b8f updated embedded kobold lite, force streaming mode if stream flag is used 2023-04-27 17:16:55 +08:00
Concedo
5eec5d6ed9 Added backwards compatibility to an earlier version of NeoX. 2023-04-25 20:34:18 +08:00
Concedo
bff998f871 Slight refactor of the python code: credits to @LuxF3rre 2023-04-25 19:20:14 +08:00
Concedo
59fb174678 fixed compile errors, made mmap automatic when lora is selected, added updated quantizers and quantization handling for gpt neox gpt 2 and gptj 2023-04-24 23:20:06 +08:00
Concedo
3962eb39c7 added token unbanning 2023-04-24 21:50:20 +08:00
Concedo
8e615c8245 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	README.md
 2023-04-24 12:20:08 +08:00
Concedo
cd6c121357 reinstated the reusable buffers -> approx 10% speedup for prompt processing 2023-04-22 22:49:27 +08:00
Concedo
6e908c1792 added lora support 2023-04-22 12:29:38 +08:00
Concedo
c454f8b848 Gpt NeoX / Pythia integration completed 2023-04-22 11:23:25 +08:00
Concedo
7ba36c2c6c trying to put out penguin based fires. sorry for inconvenience 2023-04-20 23:15:07 +08:00