Concedo
|
ca281bd5ba
|
fix sanity check
|
2025-04-28 00:00:07 +08:00 |
|
Concedo
|
5fa9e02bc3
|
add debugging info to zenity check
|
2025-04-27 23:48:23 +08:00 |
|
Concedo
|
4dcd215b27
|
handle explicit null
|
2025-04-26 13:06:38 +08:00 |
|
Concedo
|
cb1c182673
|
add more warmup (+1 squashed commits)
Squashed commits:
[9578d5352] updated lite
|
2025-04-26 10:22:09 +08:00 |
|
kallewoof
|
7cb815b727
|
AutoGuess: GLM-4 (#1502)
* AutoGuess: GLM-4
* add 'chat_start' field to adapters
* GLM-4 fix
|
2025-04-26 08:47:42 +08:00 |
|
Concedo
|
5e87c04056
|
improved memory estimation (+2 squashed commit)
Squashed commit:
[3319540f9] mem estimation
[43bad21db] mem estimation
|
2025-04-26 02:03:09 +08:00 |
|
Concedo
|
6b6597ebf1
|
allow for single token prompt processing (actual batch size 1)
|
2025-04-25 16:54:46 +08:00 |
|
Concedo
|
25e747e9d8
|
up version
|
2025-04-24 18:44:29 +08:00 |
|
Concedo
|
3e8b84b8e5
|
added support for structured output in chat completions
|
2025-04-22 22:23:36 +08:00 |
|
Concedo
|
e8b3aeaa28
|
update some defaults for max length and max ctx
|
2025-04-22 15:47:01 +08:00 |
|
Concedo
|
6dbee2f2f8
|
more robust glslc checks, increase default denoise str
|
2025-04-22 15:19:47 +08:00 |
|
Concedo
|
6494dce405
|
handle estimation for multipart gguf (+1 squashed commits)
Squashed commits:
[c7b4af92] handle estimation for multipart gguf
|
2025-04-21 22:07:22 +08:00 |
|
Concedo
|
9cd6a1add2
|
allow mmproj to be run on cpu
|
2025-04-21 21:03:10 +08:00 |
|
Concedo
|
f968079290
|
randomize image names to prevent caching in noscript
|
2025-04-21 13:24:40 +08:00 |
|
Concedo
|
2ed6850c0b
|
added override tensor
|
2025-04-20 20:56:17 +08:00 |
|
Concedo
|
75dfad2bb0
|
fixed noscript (+1 squashed commits)
Squashed commits:
[dba28399] fixed noscript
|
2025-04-19 23:16:08 +08:00 |
|
Concedo
|
12c2efdadd
|
noscript image gen
|
2025-04-19 18:56:52 +08:00 |
|
Concedo
|
305e533dc6
|
i already knew zenity would cause issues
|
2025-04-19 13:04:41 +08:00 |
|
Concedo
|
78a910be26
|
noscript chat mode tweaks
|
2025-04-19 12:40:13 +08:00 |
|
Concedo
|
a5b5d21cca
|
added chat mode to noscript
|
2025-04-19 00:59:00 +08:00 |
|
Concedo
|
5d57d62665
|
add a timeout for zenity check
|
2025-04-18 13:07:26 +08:00 |
|
Concedo
|
1a09d9cf0e
|
increase to 10 save slots
|
2025-04-18 11:30:32 +08:00 |
|
Concedo
|
c67510718e
|
kv override option (+1 squashed commits)
Squashed commits:
[e615fc01] kv override option
|
2025-04-17 14:22:30 +08:00 |
|
Concedo
|
06159939d9
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/workflows/build.yml
# Makefile
# docs/build.md
# examples/rpc/rpc-server.cpp
# examples/sycl/build.sh
# ggml/CMakeLists.txt
# ggml/src/ggml-cann/aclnn_ops.cpp
# ggml/src/ggml-cann/ggml-cann.cpp
# ggml/src/ggml-hip/CMakeLists.txt
# scripts/sync-ggml.last
|
2025-04-17 00:52:37 +08:00 |
|
Concedo
|
fbf039966c
|
debugmode has debug in cli
|
2025-04-15 23:42:46 +08:00 |
|
Concedo
|
c168b063e5
|
cli fix
|
2025-04-15 23:30:18 +08:00 |
|
Concedo
|
fe12b1cbd4
|
fixed lora, now works quanted too
|
2025-04-14 23:44:42 +08:00 |
|
Concedo
|
6bc2ca4803
|
added more sanity checks on zenity
|
2025-04-14 15:06:08 +08:00 |
|
Concedo
|
3d31d75c8f
|
clamp and display detected GPU memory
|
2025-04-14 14:19:23 +08:00 |
|
Concedo
|
a6149ad0fc
|
fixed g3 adapter back
|
2025-04-12 23:17:54 +08:00 |
|
Concedo
|
6302709fbb
|
discourage but dont prevent vulkan FA (it's occasionally still useful)
|
2025-04-12 16:23:52 +08:00 |
|
Concedo
|
5908f2ca19
|
based on occam and henky advice, disabled flash attention entirely on vulkan.
|
2025-04-12 12:30:48 +08:00 |
|
Concedo
|
7a7bdeab6d
|
json to gbnf endpoint added
|
2025-04-12 11:41:11 +08:00 |
|
Concedo
|
a56cc72bd0
|
added handling for remembering file paths, added gui option to disable zenity in GUI
|
2025-04-12 00:42:26 +08:00 |
|
henk717
|
f6b7fea979
|
zentk - folder select workaround (#1478)
* zentk - folder select workaround
* kcppt extention fix
|
2025-04-11 22:37:07 +08:00 |
|
henk717
|
8fd70f37bd
|
Zentk integration (Zenity/yad support) (#1475)
* Zentk integration (Zenity/yad support)
* Escape incompatible dependencies in zentk
* Properly clean env
|
2025-04-11 18:23:23 +08:00 |
|
Concedo
|
27f575dc83
|
inpaining support completed, invert mask added
|
2025-04-09 23:50:17 +08:00 |
|
Concedo
|
23339ace9b
|
inpainting works in kcpp!
|
2025-04-09 23:01:05 +08:00 |
|
Concedo
|
26e1653255
|
fixed templates not setting gpu when swapped with admin mode
|
2025-04-08 21:45:18 +08:00 |
|
Concedo
|
b99ee451f8
|
Merge commit '4ccea213bc' into concedo_experimental
# Conflicts:
# .devops/cpu.Dockerfile
# .devops/cuda.Dockerfile
# .devops/intel.Dockerfile
# .devops/musa.Dockerfile
# .devops/rocm.Dockerfile
# .github/workflows/bench.yml.disabled
# .github/workflows/build.yml
# .github/workflows/server.yml
# CMakeLists.txt
# build-xcframework.sh
# ci/run.sh
# common/CMakeLists.txt
# examples/llama.android/llama/build.gradle.kts
# examples/perplexity/perplexity.cpp
# examples/run/CMakeLists.txt
# examples/server/tests/README.md
# examples/sycl/win-build-sycl.bat
# ggml/src/ggml-cann/aclnn_ops.cpp
# ggml/src/ggml-cann/aclnn_ops.h
# ggml/src/ggml-cpu/CMakeLists.txt
# ggml/src/ggml-cpu/ggml-cpu.c
# licenses/LICENSE-linenoise
# scripts/sync-ggml.last
# tests/CMakeLists.txt
|
2025-04-08 21:26:23 +08:00 |
|
Concedo
|
8e23a087e7
|
updated readme, memory detection prints
|
2025-04-08 20:23:52 +08:00 |
|
Concedo
|
11c4e7c2c4
|
automatic memory detection for vulkan
|
2025-04-07 22:56:12 +08:00 |
|
Concedo
|
11f993ca10
|
added flag to adjust max request size
|
2025-04-06 00:13:00 +08:00 |
|
Concedo
|
65cd25d3a1
|
some data sanitization
|
2025-04-05 18:42:26 +08:00 |
|
Concedo
|
93a226d9e4
|
added prefix for llava, reverted system role in template as it degreaded gemma3. truncated debug logs
|
2025-04-05 18:06:41 +08:00 |
|
Concedo
|
34ddd874fe
|
try containerized ci (+3 squashed commit)
Squashed commit:
[f0600744] troubleshooting
[fe11073c] cap auto threads at 32 due to diminishing returns
[0c7f8a1d] troubleshooting
|
2025-04-05 01:51:03 +08:00 |
|
Concedo
|
c48a4a73d4
|
try fix file open
|
2025-04-04 14:38:17 +08:00 |
|
Concedo
|
43e9b049d6
|
another silly bug silly silly silly (tavern)
|
2025-04-04 14:16:42 +08:00 |
|
Concedo
|
07a96d63fa
|
try to ensure correct file extension
|
2025-04-03 20:13:53 +08:00 |
|
Concedo
|
6e086bd309
|
fixed savedatafile bug, try remove unneeded old clblast code path
|
2025-04-03 19:11:27 +08:00 |
|