Commit graph

1580 commits

Author SHA1 Message Date
Concedo
849ec89bad restructure some compilation units 2026-07-01 18:51:25 +08:00
Concedo
983dec9a54 prevent MTP drafting with batching 2026-07-01 16:17:13 +08:00
Concedo
ca3a77a87b testing max nodes per submit 2026-06-30 22:26:02 +08:00
Concedo
1365d11990 context shifting now works with images, images are now inserted inline instead of as placeholders 2026-06-29 23:40:43 +08:00
Concedo
0677ddd19d fixed output not showing thinking (+1 squashed commits)
Squashed commits:

[cc9f0a026] fixed output not showing thinking
2026-06-29 16:10:08 +08:00
Concedo
0c163a9b4c fixed reasoning when non streaming 2026-06-28 12:35:03 +08:00
Concedo
9c5cdcc256 xet resolution fix 2026-06-27 23:09:16 +08:00
Concedo
e8e13ee8d2 switch back to 16 parallel workers for download on henky request 2026-06-26 23:01:49 +08:00
Concedo
73607e9e01 added xet resolver and downloader 2026-06-26 17:58:43 +08:00
Concedo
e35e415668 deduplicate aria2 2026-06-26 17:35:50 +08:00
Concedo
29d312eda8 add continue and retry wait 2026-06-26 16:27:02 +08:00
Concedo
b46f7450c7 increase sd prompt limit 2026-06-26 00:18:00 +08:00
Concedo
145beb5744 try to use llama.cpp's tool call parser first 2026-06-25 18:11:44 +08:00
Concedo
4a7d6dd8a0 alias for draft 2026-06-23 18:43:28 +08:00
Concedo
08fbef5049 lcpp ui think budget 2026-06-21 22:56:10 +08:00
Concedo
44bcead521 mcp fixes 2026-06-21 22:28:47 +08:00
Concedo
1afe5a730a minor fixes to handler newer lcpp ui 2026-06-21 22:21:10 +08:00
Concedo
9b1e2fa8b8 advanced onready bypass 2026-06-19 21:44:37 +08:00
Concedo
df08e951d0 response format returns actual mp3 filename if requested 2026-06-19 15:18:53 +08:00
Concedo
6f4325ac87 support mp3 from api 2026-06-19 10:26:34 +08:00
Concedo
2bc18617ba move jinja to the quick tab 2026-06-18 23:52:17 +08:00
Concedo
1b36e7f606 option to save tts as mp3, currently slightly bugged 2026-06-18 22:16:29 +08:00
Concedo
635c45e1a0 fix incorrect mtp layers setting (+1 squashed commits)
Squashed commits:

[8dad1a5c0] fix incorrect mtp layers setting
2026-06-18 21:10:28 +08:00
Concedo
eb05dd5fab support audio to video for ltx 2.3 2026-06-17 23:50:08 +08:00
Concedo
05dbd9a195 fix exception on exit 2026-06-16 17:45:56 +08:00
Concedo
71801743c4 added support for cohere north mini 2026-06-16 00:24:30 +08:00
Concedo
093067ec01 support apriel 2026-06-15 23:39:40 +08:00
Concedo
a91357614a added lfm2 tool call template support 2026-06-15 22:55:24 +08:00
Concedo
be80f5dcbc auto fitting for draft models 2026-06-15 19:36:54 +08:00
Concedo
7b217c3d7c reduce default draft amount to 4 2026-06-15 11:47:45 +08:00
Concedo
de08137d51 mcp handle relative paths 2026-06-15 11:20:43 +08:00
Concedo
18665a574a adjust max ctx back to 12288, allow img2img with ref images 2026-06-15 11:15:40 +08:00
Concedo
8c54b65495 img2img allow extra images 2026-06-15 10:55:35 +08:00
Concedo
cf28c48825 up version 2026-06-14 17:22:08 +08:00
Concedo
a06c915eb4 performance optimizations 2026-06-14 17:07:10 +08:00
Concedo
af96c9001d temporarily disable stream layers 2026-06-13 15:30:00 +08:00
Wagner Bruna
fdc9c96124
sd: sync with master-685-19bdfe2 (#2265)
* sd: sync with master-682-b3d56d0

* sd: sync with master-685-19bdfe2

* sd: enable layer streaming
2026-06-13 11:14:44 +08:00
Concedo
40084bb1f8 mtp drafting added (+1 squashed commits)
Squashed commits:

[b0fa1a6de] wip 1
2026-06-11 15:25:49 +08:00
Concedo
e8ead6efaa increase ctx and gen amt defaults 2026-06-10 18:00:26 +08:00
Concedo
afc8de2c6b Merge branch 'upstream' into concedo_experimental
# Conflicts:
#	.devops/cpu.Dockerfile
#	.devops/cuda.Dockerfile
#	.devops/intel.Dockerfile
#	.devops/musa.Dockerfile
#	.devops/openvino.Dockerfile
#	.devops/rocm.Dockerfile
#	.devops/vulkan.Dockerfile
#	.devops/zendnn.Dockerfile
#	.github/workflows/build-webgpu.yml
#	.github/workflows/release.yml
#	ggml/src/ggml-webgpu/ggml-webgpu-shader-lib.hpp
#	ggml/src/ggml-webgpu/ggml-webgpu.cpp
#	ggml/src/ggml-webgpu/wgsl-shaders/binary.wgsl
#	ggml/src/ggml-webgpu/wgsl-shaders/concat.wgsl
#	ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_decls.tmpl
#	ggml/src/ggml-webgpu/wgsl-shaders/scale.wgsl
#	ggml/src/ggml-webgpu/wgsl-shaders/unary.wgsl
#	tests/CMakeLists.txt
#	tests/test-backend-ops.cpp
#	tests/test-mtmd-c-api.c
#	tools/cli/cli.cpp
#	tools/mtmd/CMakeLists.txt
#	tools/server/README.md
2026-06-10 17:21:05 +08:00
Concedo
8cf8469bb8 reasoningeffort param 2026-06-10 10:30:57 +08:00
Concedo
e839598185 think effort box 2026-06-10 01:32:42 +08:00
Concedo
f5acccad63 cleanup round 1 2026-06-09 21:13:48 +08:00
Concedo
d76464b2a9 default top_p 0.9 2026-06-09 14:29:23 +08:00
Concedo
c622a7b96b default temp 0.7 2026-06-08 16:34:52 +08:00
Concedo
b5ae1305d4 toggle jinja enables jinjatools 2026-06-08 16:31:21 +08:00
Concedo
0184f27804 handle anthropic tool responses 2026-06-08 16:16:22 +08:00
Concedo
d1b5db9109 claude support multimedia content 2026-06-08 15:33:42 +08:00
Concedo
21a774a12d anthropic handle thinking 2026-06-08 14:55:46 +08:00
Concedo
b7a16b819c still wip for claude tool calling 2026-06-08 01:26:40 +08:00