Concedo
94e0a06daf
updated lite, up ver (+1 squashed commits)
...
Squashed commits:
[7d6520f] updated lite, up ver
2023-07-26 11:03:17 +08:00
Concedo
66e4b5141e
fix horde worker host and client agent
2023-07-25 18:18:41 +08:00
Concedo
d8d2449bfb
better label (+1 squashed commits)
...
Squashed commits:
[f573b2c] cuda 3 target arch
2023-07-24 23:07:31 +08:00
Concedo
7555dae4cc
ditch advanced subparsers
2023-07-24 22:40:36 +08:00
Concedo
825e34baa3
default horde name and better handling for horde (+3 squashed commit)
...
Squashed commit:
[fadfa60] better idle handling for horde worker
[a3971e6] updated lite
[2ca2b79] seems to not generate rubbish
2023-07-24 18:41:41 +08:00
Concedo
c7136f03d9
added support for tensor_split parameter as an advanced parameter.
2023-07-24 17:16:19 +08:00
Concedo
280abaf029
added stop reason in the perf endpoint
2023-07-24 11:55:35 +08:00
Concedo
0cca0726fe
reduce number of retries, fixed maxlength > maxctx bug
2023-07-23 09:59:34 +08:00
Concedo
fa0270df7c
added some checks to skip generation if busy
2023-07-22 23:10:04 +08:00
Concedo
2807d98fd4
touchup (+2 squashed commit)
...
Squashed commit:
[8b06458] fixed broken param order
[7eabdc0] very broken, do not use
2023-07-22 22:57:56 +08:00
Concedo
3aec3038d4
bump scratch buffers
2023-07-22 18:12:18 +08:00
Concedo
52c5856a08
auto populate horde model name
2023-07-22 16:03:12 +08:00
Concedo
dd3f8dabed
updated cluster to horde.koboldai.net
2023-07-22 12:42:40 +08:00
Concedo
236d0e8955
add tip about using other workers
2023-07-22 12:29:22 +08:00
Concedo
701bf0a6cd
reduce sleep time between jobs
2023-07-22 11:56:43 +08:00
Concedo
52c98228aa
bugfixes for missing params
2023-07-22 11:37:44 +08:00
Concedo
d7ab6adbc1
embedded horde worker is ready
2023-07-22 11:21:32 +08:00
Concedo
75064b4ada
wip on embedded horde worker
2023-07-22 01:30:25 +08:00
Concedo
e85557f798
launcher for rope
2023-07-20 17:45:50 +08:00
Concedo
39dc1a46c4
added token count, updated lite
2023-07-20 14:41:06 +08:00
Concedo
2a88d6d3ec
Merge remote-tracking branch 'ycros/api-modelbusy-fix' into concedo_experimental
2023-07-19 18:32:13 +08:00
Concedo
e9467f5a44
auto rope scale adjustments, added sched yield fix for apple, adjust warning for mirostat
2023-07-19 16:44:44 +08:00
Concedo
374fffb9c6
Reworking rope WIP
2023-07-19 00:54:41 +08:00
Concedo
0a11f50da8
reenabled sched_yield, reduced sampler warning msg to once per session
2023-07-18 20:26:18 +08:00
Concedo
6d32e7fc8b
Merge commit ' a6803cab94' into concedo_experimental
...
# Conflicts:
# .devops/tools.sh
# Makefile
# build.zig
# flake.nix
# ggml-cuda.cu
# ggml.h
# tests/test-grad0.c
# tests/test-opt.c
2023-07-18 19:12:06 +08:00
Ycros
fd90d52127
API: Replace modelbusy bool with a lock.
...
- Also remove duplicate Content-Type header on streams responses.
2023-07-18 20:09:50 +10:00
Concedo
1d1111e10f
expose timing info in web api
2023-07-11 18:56:06 +08:00
Concedo
7222877069
Merge remote-tracking branch 'ren/concedo' into concedo_experimental
2023-07-11 18:45:36 +08:00
Concedo
5ca204d527
Merge remote-tracking branch 'yellowrose/pr/open/LostRuins/koboldcpp/multigpu-cuda-gui' into concedo_experimental
...
# Conflicts:
# koboldcpp.py
2023-07-11 18:22:54 +08:00
Concedo
4be167915a
added linear rope option, added warning for bad samplers
2023-07-11 18:08:19 +08:00
Concedo
9324cb804a
reimplemented save and load
2023-07-10 22:49:27 +08:00
YellowRoseCx
f1014f3cc7
remove unused .re
2023-07-10 00:26:40 -05:00
YellowRoseCx
242f01e983
Add Multi-GPU CuBLAS support in the new GUI
2023-07-09 17:10:14 -05:00
callMeMakerRen
4e46673f80
Merge branch 'LostRuins:concedo' into concedo
2023-07-08 09:33:26 +08:00
Concedo
8edcb337c6
added ability to select "all devices"
2023-07-07 23:37:55 +08:00
Concedo
ddaa4f2a26
fix cuda garbage results and gpu selection issues
2023-07-07 22:14:14 +08:00
Concedo
95eca51bef
add gpu choice for GUI for cuda
2023-07-07 18:39:47 +08:00
Concedo
a689a66068
make it work with pyinstaller
2023-07-07 17:52:34 +08:00
Concedo
9ee9a77f12
warn outdated GUI (+1 squashed commits)
...
Squashed commits:
[15aec3d] spelling error
2023-07-07 16:39:17 +08:00
Concedo
32102c2064
Merge branch 'master' into concedo_experimental
...
# Conflicts:
# README.md
2023-07-07 14:15:39 +08:00
shutup
894c72819c
Merge branch 'concedo' of https://github.com/callMeMakerRen/koboldcpp into concedo
2023-07-07 11:57:25 +08:00
shutup
1727e652f1
expose some useful info that can be used in statistics of performence
2023-07-07 11:52:58 +08:00
Concedo
8424a35c62
added the ability to ban any substring tokens
2023-07-06 23:24:21 +08:00
Concedo
27a0907cfa
backport MM256_SET_M128I to ggml_v2, updated lite, added support for selecting the GPU for cublas
2023-07-06 22:33:46 +08:00
Concedo
4d1700b172
adjust some ui sizing
2023-07-06 15:17:47 +08:00
Vali-98
1c80002310
New UI using customtkinter ( #284 )
...
* Initial conversion to customtkinter.
* Initial conversion to customtkinter.
* Additions to UI, still non-functional
* UI now functional, untested
* UI now functional, untested
* Added saving configs
* Saving and loading now functional
* Fixed sliders not loading
* Cleaned up duplicate arrays
* Cleaned up duplicate arrays
* Fixed loading bugs
* wip fixing all the broken parameters. PLEASE test before you commit
* further cleaning
* bugfix completed for gui. now evaluating save and load
* cleanup prepare to merge
---------
Co-authored-by: Concedo <39025047+LostRuins@users.noreply.github.com>
2023-07-06 15:00:57 +08:00
Concedo
00e35d0bbf
Merge branch 'concedo' into concedo_experimental
2023-07-04 18:46:40 +08:00
Michael Moon
f9108ba401
Make koboldcpp.py executable on Linux ( #293 )
2023-07-04 18:46:08 +08:00
Concedo
c6c0afdf18
refactor to avoid code duplication
2023-07-04 18:35:54 +08:00
Ycros
309534dcd0
implement sampler order, expose sampler order and mirostat in api
2023-07-02 18:15:34 +00:00
