vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-07-26 01:03:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
13824 commits 3 branches 249 tags 837 MiB
Commit graph

1535 commits

Author SHA1 Message Date
Concedo
b5ae1305d4 toggle jinja enables jinjatools 2026-06-08 16:31:21 +08:00
Concedo
0184f27804 handle anthropic tool responses 2026-06-08 16:16:22 +08:00
Concedo
d1b5db9109 claude support multimedia content 2026-06-08 15:33:42 +08:00
Concedo
21a774a12d anthropic handle thinking 2026-06-08 14:55:46 +08:00
Concedo
b7a16b819c still wip for claude tool calling 2026-06-08 01:26:40 +08:00
Concedo
52630ad13a wip anthropic tool calling 2026-06-08 00:58:43 +08:00
Concedo
c74af42711 handle anthropic tool calls 2026-06-07 23:20:42 +08:00
Concedo
da35c69bc4 clean path and strip query params for all http POST routes 2026-06-07 22:37:00 +08:00
Concedo
119837c5a1 ssl accept more extensions (+1 squashed commits) 
Squashed commits:

[d8ac08225] ssl accept more extensions
 2026-06-07 21:06:36 +08:00
Wagner Bruna
b1dc6110f0
sd: fix utf-8 prompt handling (#2254) 2026-06-07 13:37:20 +08:00
Concedo
a9d743634c reordered some args 2026-06-05 17:27:17 +08:00
Concedo
19b5f811c3 allow up to 32 fps 2026-06-01 17:37:46 +08:00
Concedo
f4186b767b up version 2026-06-01 16:26:20 +08:00
Concedo
c3246cd392 allow SD to limit max VRAM usage 2026-06-01 16:06:27 +08:00
Concedo
485113f74c low default vae tiling to 640 2026-06-01 10:50:31 +08:00
Concedo
14b7da5e44 allow reversing the reference image 2026-05-31 23:08:58 +08:00
Concedo
f90d9240f1 fixed auto gpu selection issues 2026-05-31 14:00:46 +08:00
Concedo
4cd3888e9b increase frame limit 2026-05-31 01:30:43 +08:00
Concedo
cc9490d9b0 default embed max ctx to 4096 2026-05-31 01:23:54 +08:00
Concedo
5a4a3a34cb allow setting backend automatically even if model is unset but sdmodel is set 2026-05-31 00:54:59 +08:00
Concedo
3361ef801c video vae tiling fix 2026-05-30 22:59:15 +08:00
Concedo
5dc1a89001 support final frame 2026-05-30 09:27:51 +08:00
Concedo
b427dde1a5 increase total frame cap once more to 160 2026-05-30 01:34:43 +08:00
Concedo
48a6d161a5 add fps controls 2026-05-29 23:18:14 +08:00
Concedo
272c1ee232 increase frame limit to 120 and allow loading tae ltx 2026-05-29 18:50:01 +08:00
Concedo
13663730a9 ltx wip 2026-05-28 22:45:24 +08:00
Concedo
af42dc14a3 handle chat template kwargs passed by api 2026-05-28 19:25:22 +08:00
Concedo
7dbe82bb47 screen reader warning 2026-05-27 12:31:31 +08:00
Concedo
c6b32ce1f2 message for screen readers in the terminal 2026-05-27 12:17:01 +08:00
Concedo
e434b3e61b kcpp image handling fix 2026-05-26 14:32:53 +08:00
Concedo
39a4ca08f4 alpin's cont batching is now no longer hidden, added as --parallelrequests, also added to GUI 2026-05-25 17:47:46 +08:00
Concedo
9639ab2fb6 support comfy scheduler 2026-05-25 00:22:40 +08:00
Concedo
e6715b7f8a additional SD aliases for comfyui 2026-05-24 23:20:44 +08:00
Concedo
29fd00a7a4 allow accessing tensor split and gpu layers in cpu mode if rpc is in connect mode 2026-05-24 22:23:51 +08:00
Concedo
86f6bff620 rpc port to 5551 2026-05-24 18:56:23 +08:00
Concedo
4bbbd55be6 rpc implementation is complete 2026-05-23 17:11:30 +08:00
Concedo
81553e6524 mmproj overhead estimate calculated but only used on python side 2026-05-23 00:04:12 +08:00
Concedo
f85cc79526 make swa default on models that support it. removed --useswa, added --noswa 2026-05-22 23:38:33 +08:00
Concedo
694e8824c5 mmproj autofit reworked 2026-05-22 20:36:16 +08:00
Concedo
de6b8f9369 increase ctx slider granularity 2026-05-22 16:17:54 +08:00
Concedo
2451feaf69 an easy way to toggle thinking for jinja 2026-05-21 22:45:33 +08:00
Concedo
e8bf5b9c6c fixed a potential vuln with onready when combined with admin 2026-05-21 16:11:28 +08:00
Wagner Bruna
f85a747dc0
sd: add backend support for max_vram (#2221) 2026-05-21 11:51:00 +08:00
Wagner Bruna
643862ac7d
sd: device selection fixes and improvements (#2220) 
* sd: remove device offset for zero-based indexes

* sd: cleanup and document sd device mappings

* sd: change sdmaingpu control to match other sd devices
 2026-05-20 15:31:19 +08:00
Concedo
b909b32135 remove off by 1 offset for sd 2026-05-20 15:23:56 +08:00
Concedo
c95d25abe2 gui visual breaking change - make GPU ID list 0-based index instead of 1-based index to match CLI 2026-05-19 22:00:43 +08:00
Wagner Bruna
592d12d0a3
sd: support for CLIP and VAE on different devices (#2184) 
* sd: generalize internal interfaces to place generation on CPU

* sd: backend support for multi-device selection

* sd: frontend support for multi-device selection

* add deprecated flags to avoid breaking old cli args

---------

Co-authored-by: Concedo <39025047+LostRuins@users.noreply.github.com>
 2026-05-19 21:51:23 +08:00
Concedo
7232096c11 Merge branch 'concedo' into concedo_experimental 
# Conflicts:
#	koboldcpp.py
 2026-05-19 20:35:11 +08:00
Concedo
8bdef0bcfe hotfix 1.113.2 bugs 2026-05-19 20:33:57 +08:00
Concedo
fecf2dc3fa Merge branch 'upstream' into concedo_experimental 
# Conflicts:
#	.github/workflows/server-self-hosted.yml
#	CMakeLists.txt
#	CODEOWNERS
#	ci/run.sh
#	cmake/llama-config.cmake.in
#	common/chat.cpp
#	examples/sycl/start-svr.sh
#	examples/sycl/test.sh
#	examples/sycl/win-start-svr.bat
#	examples/sycl/win-test.bat
#	ggml/src/ggml-sycl/ggml-sycl.cpp
#	ggml/src/ggml-sycl/vecdotq.hpp
#	ggml/src/ggml-vulkan/CMakeLists.txt
#	scripts/wc2wt.sh
#	tests/test-backend-ops.cpp
#	tests/test-chat.cpp
 2026-05-18 21:27:23 +08:00