vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2025-09-13 10:29:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
2292 commits 3 branches 196 tags 390 MiB
Commit graph

108 commits

Author SHA1 Message Date
Concedo
e46708eedc updated lite 2023-10-07 23:33:54 +08:00
Concedo
ca4a8c5dc8 updated lite 2023-10-07 21:50:24 +08:00
Concedo
2a36c85558 abort has multiuser support via genkey too 2023-10-06 23:27:00 +08:00
Concedo
84eeecb889 updated lite 2023-10-06 23:15:11 +08:00
Concedo
9d2a25b12b updated lite, fixed fancy quotes 2023-10-06 15:44:37 +08:00
Concedo
ce065d39d0 allow drag and drop kcpps file and openwith 2023-10-05 11:38:37 +08:00
Concedo
0cc740115d updated lite, improve horde worker (+1 squashed commits) 
Squashed commits:

[a7c25999] improve horde worker
 2023-10-03 23:44:27 +08:00
Concedo
dffc6bee74 deprecate some launcher arguments. 2023-10-01 22:30:48 +08:00
Concedo
bc841ec302 flag to retain grammar, fix makefile (+2 squashed commit) 
Squashed commit:

[d5cd3f28] flag to retain grammar, fix makefile

[b3352963] updated lite to v73
 2023-10-01 14:39:56 +08:00
Concedo
4b45d880ba updated lite 2023-10-01 01:10:30 +08:00
Concedo
202e28a76a do not offload rope for old cublas (+1 squashed commits) 
Squashed commits:

[ca72a66f] fix allocr (+1 squashed commits)

Squashed commits:

[22a0e30e] updated lite
 2023-09-30 18:18:36 +08:00
Concedo
ca8b315202 increase context for gguf to 32k, horde worker stats, fixed glitch in horde launcher ui, oai freq penalty, updated lite 2023-09-28 23:50:08 +08:00
Concedo
6a821b268a improved SSE streamiing 2023-09-28 17:33:34 +08:00
Concedo
38d4c6cedd updated lite 2023-09-27 16:06:17 +08:00
Concedo
fdadbd0fbb updated lite (+1 squashed commits) 
Squashed commits:

[b4408c79] updated lite
 2023-09-24 23:07:37 +08:00
Concedo
8ecf505d5d improved embedded horde worker (+2 squashed commit) 
Squashed commit:

[99234379] improved embedded horde worker

[ebcd1968] update lite
 2023-09-24 15:16:49 +08:00
Concedo
32cf02487e colab use mmq, update lite and ver 2023-09-23 23:32:00 +08:00
Concedo
bfc696fcc4 update lite, update ver 2023-09-23 12:35:23 +08:00
Concedo
1f9e36c733 minor lite fixes 2023-09-23 09:37:49 +08:00
Concedo
14295922f9 updated ver, updated lite (+1 squashed commits) 
Squashed commits:

[891291bc] updated lite to v67
 2023-09-21 17:44:01 +08:00
Concedo
4a0c515da7 rename notepad to classic 2023-09-20 17:51:02 +08:00
Concedo
436cd474cd regex fix 2023-09-20 16:02:19 +08:00
Concedo
2fc91d8727 updated lite 2023-09-20 14:28:55 +08:00
Concedo
c03409c1f6 grammar sampling added for lite 2023-09-19 00:13:30 +08:00
Concedo
34930bfdc2 updated lite 2023-09-17 20:43:04 +08:00
Concedo
6b7af55db5 updated lite 2023-09-15 16:44:13 +08:00
Concedo
2dc96687eb updated lite 2023-09-07 15:18:24 +08:00
Concedo
b61ae67082 use HIP visible devices, updated lite 2023-09-03 11:46:19 +08:00
Concedo
07b02af8bc fixed tab ordering , update lite for panel alignment 2023-08-31 16:33:00 +08:00
Concedo
e2fd30b5d1 reverted the failsafe removal, since they dropped support for dll check 2023-08-31 15:39:32 +08:00
Concedo
5cd0309610 renamed incorrect identifier 2023-08-30 23:06:39 +08:00
Concedo
1301bd7e29 Fix to skip GPU offloading so falcon models work correctly 2023-08-30 18:26:41 +08:00
Concedo
d4c22a8b02 updated lite, added autorope config based on trained ctxlen, hotfix for falcon gpu broken 2023-08-30 16:50:55 +08:00
Concedo
81a0ef342c updated lite, switched to unminified source 2023-08-24 16:26:38 +08:00
Concedo
886f4eed79 updated lite, up ver, remove bell 2023-08-10 22:01:33 +08:00
Concedo
793cfd136c fixed 70B detection again, try fix horde issues, fixed lite unicode issue, fixed cmake for cuda 2023-08-09 01:05:00 +08:00
Concedo
3c7d938d95 update lite, resize scratch buffers for blasbatch 2048 2023-08-08 00:32:51 +08:00
Concedo
559c0e2d1f updated lite again, fix for wi 2023-08-07 10:15:20 +08:00
Concedo
198cc826fc updated lite 2023-08-06 22:19:18 +08:00
Concedo
b2eaec4261 updated lite 2023-08-02 22:54:17 +08:00
Concedo
94e0a06daf updated lite, up ver (+1 squashed commits) 
Squashed commits:

[7d6520f] updated lite, up ver
 2023-07-26 11:03:17 +08:00
Concedo
825e34baa3 default horde name and better handling for horde (+3 squashed commit) 
Squashed commit:

[fadfa60] better idle handling for horde worker

[a3971e6] updated lite

[2ca2b79] seems to not generate rubbish
 2023-07-24 18:41:41 +08:00
Concedo
c28ab4e1b7 update lite, try support k80 2023-07-23 21:50:35 +08:00
Concedo
39dc1a46c4 added token count, updated lite 2023-07-20 14:41:06 +08:00
Concedo
c49a469a79 updated lite 2023-07-19 21:13:00 +08:00
Concedo
13e34d5058 Merge remote-tracking branch 'origin/master' into concedo_experimental 
# Conflicts:
#	CMakeLists.txt
#	README.md
#	flake.nix
#	tests/CMakeLists.txt

update readme and lite
 2023-07-19 18:28:29 +08:00
Concedo
a286776435 updated lite 2023-07-11 21:48:01 +08:00
Concedo
b0b131499f Merge branch 'master' into concedo_experimental 
# Conflicts:
#	.github/workflows/build.yml
#	CMakeLists.txt
#	Makefile
#	README.md
#	tests/test-tokenizer-0.cpp
 2023-07-11 16:12:15 +08:00
Concedo
9324cb804a reimplemented save and load 2023-07-10 22:49:27 +08:00
Concedo
27a0907cfa backport MM256_SET_M128I to ggml_v2, updated lite, added support for selecting the GPU for cublas 2023-07-06 22:33:46 +08:00