Concedo
|
4f1b22c415
|
kv snapshots save and load last logits for correctness. added some text for musicui, updated docs
|
2026-03-04 21:57:28 +08:00 |
|
Concedo
|
54cf43ae64
|
rnn fix adjust
|
2026-03-04 10:59:51 +08:00 |
|
Concedo
|
707f7b37bf
|
optimize pp
|
2026-03-03 21:02:51 +08:00 |
|
Concedo
|
ae67caa2f7
|
ace qwen rep pen for codes
|
2026-03-02 21:18:06 +08:00 |
|
Concedo
|
d904b51b0f
|
adjust slot counts
|
2026-03-02 15:56:15 +08:00 |
|
Concedo
|
42134db6b4
|
finally fixed smartcache for qwen
|
2026-03-02 00:47:38 +08:00 |
|
Concedo
|
0b76f73fc2
|
smartcache bug seems to be fixed
|
2026-02-28 18:08:54 +08:00 |
|
Concedo
|
dd08d675f2
|
incomplete fix for rnn models, load state works but logits slightly different
|
2026-02-28 11:52:24 +08:00 |
|
Concedo
|
72f7e01b27
|
Merge commit '01d8eaa28d' into concedo_experimental
# Conflicts:
# build-xcframework.sh
# scripts/sync_vendor.py
# tests/test-backend-ops.cpp
# tools/mtmd/CMakeLists.txt
# tools/rpc/rpc-server.cpp
|
2026-02-16 15:36:59 +08:00 |
|
Concedo
|
9258d91b70
|
try initi rocblas before autofit
|
2026-02-11 22:29:47 +08:00 |
|
Concedo
|
e6d271db05
|
fixed typo
|
2026-02-09 17:12:03 +08:00 |
|
Concedo
|
3d3f02ef4a
|
revert layers if fail
|
2026-02-08 12:58:05 +08:00 |
|
Concedo
|
6bfbb5b283
|
allow autofit logspam in debugmode
|
2026-02-08 01:00:41 +08:00 |
|
Concedo
|
5cf21443bc
|
added autofit padding. autofit is now in the quick menu
|
2026-02-07 18:29:30 +08:00 |
|
Concedo
|
812da8b75d
|
fix autofit spamming
|
2026-02-07 18:01:01 +08:00 |
|
Concedo
|
349c461453
|
add stop reason for error
|
2026-02-04 20:23:18 +08:00 |
|
Concedo
|
226c79338f
|
handle glm4.7 flash template
|
2026-01-28 23:29:08 +08:00 |
|
Concedo
|
5c6cc02985
|
remove clblast, part 2
|
2026-01-23 14:09:46 +08:00 |
|
Concedo
|
3816391a74
|
increase logprobs returned to 10
|
2026-01-18 11:13:42 +08:00 |
|
Concedo
|
62bea5ef4f
|
allow overriding the devices directly
|
2026-01-17 19:08:06 +08:00 |
|
Concedo
|
983baac46b
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .devops/vulkan.Dockerfile
# .github/workflows/build.yml
# ci/run.sh
# examples/model-conversion/Makefile
# examples/model-conversion/README.md
# examples/model-conversion/scripts/causal/compare-logits.py
# examples/model-conversion/scripts/embedding/run-converted-model.sh
# examples/model-conversion/scripts/utils/common.py
# examples/model-conversion/scripts/utils/semantic_check.py
# ggml/src/ggml-cann/ggml-cann.cpp
# ggml/src/ggml-cuda/CMakeLists.txt
# ggml/src/ggml-opencl/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-webgpu/ggml-webgpu.cpp
# scripts/pr2wt.sh
# scripts/sync_vendor.py
# tests/test-arg-parser.cpp
|
2026-01-09 01:23:10 +08:00 |
|
Concedo
|
d8942cde14
|
smartcache allow custom number of slots
|
2026-01-02 17:19:40 +08:00 |
|
Concedo
|
bfa2ae7744
|
fixed smartcache bug when used with images
|
2026-01-02 00:35:05 +08:00 |
|
Concedo
|
51edb6ae61
|
allow clip fa for anything besides cuda on gpu
|
2026-01-01 21:09:51 +08:00 |
|
Concedo
|
54e419f587
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/workflows/docker.yml
# docs/ops.md
# docs/ops/Metal.csv
# ggml/CMakeLists.txt
# ggml/src/ggml-sycl/CMakeLists.txt
# grammars/README.md
# models/templates/llama-cpp-deepseek-r1.jinja
# scripts/sync-ggml.last
# tests/test-chat.cpp
|
2026-01-01 15:34:10 +08:00 |
|
Concedo
|
76ef726ec8
|
adaptive p sharpness to 10.0f
|
2025-12-31 17:28:30 +08:00 |
|
Concedo
|
0e26e4d354
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/ISSUE_TEMPLATE/010-bug-compilation.yml
# .github/ISSUE_TEMPLATE/011-bug-results.yml
# .github/ISSUE_TEMPLATE/019-bug-misc.yml
# ggml/CMakeLists.txt
# ggml/src/CMakeLists.txt
# ggml/src/ggml-cuda/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-rpc/ggml-rpc.cpp
|
2025-12-28 23:47:55 +08:00 |
|
Concedo
|
21d801f6d5
|
init total weight for adaptive p
|
2025-12-28 15:33:06 +08:00 |
|
Concedo
|
27261bfc26
|
adaptive decay as an overridable param (+1 squashed commits)
Squashed commits:
[d94df7843] adaptive decay as an overridable param
|
2025-12-28 13:34:20 +08:00 |
|
Concedo
|
6548645aaa
|
rename power law sampler to adaptive p
|
2025-12-27 17:50:58 +08:00 |
|
Concedo
|
9bb362cce9
|
revised power law sampling
|
2025-12-27 10:59:46 +08:00 |
|
Concedo
|
91d8863f18
|
power law sampler added
|
2025-12-27 09:46:06 +08:00 |
|
Concedo
|
cf4201e213
|
wip power law sampling
|
2025-12-25 22:01:16 +08:00 |
|
Concedo
|
4b899b19dc
|
fixed save state a bit better
|
2025-12-21 22:24:13 +08:00 |
|
Concedo
|
80a0269dbe
|
improve snapshotting for rnn
|
2025-12-21 21:07:31 +08:00 |
|
Concedo
|
fedd529fdc
|
autofit counts overheads
|
2025-12-21 14:31:08 +08:00 |
|
Concedo
|
2e57e5ead4
|
rename eval function
|
2025-12-19 17:54:23 +08:00 |
|
Concedo
|
e9ae0cb2dd
|
added support for RNN models in smartcache
|
2025-12-19 16:36:25 +08:00 |
|
Concedo
|
cde4791e36
|
fix tools building
|
2025-12-19 12:08:29 +08:00 |
|
Concedo
|
fb31059f9c
|
fixed a bug in vision with mrope, mrope is refactored to match upstream, should be more accurate now
|
2025-12-19 01:23:52 +08:00 |
|
Concedo
|
cefb32df19
|
track clip img patch nx and ny
|
2025-12-18 22:58:10 +08:00 |
|
Concedo
|
fae2ff6d2d
|
fix override tensors string matching issue (+2 squashed commit)
Squashed commit:
[850340501] will be deleted later, quick test
[eb4f569a7] debug buffer types
|
2025-12-18 21:22:49 +08:00 |
|
Concedo
|
04122d0a24
|
projector tags
|
2025-12-17 23:12:25 +08:00 |
|
Concedo
|
1daeed5d4d
|
Merge commit '9963b81f63' into concedo_experimental
# Conflicts:
# .github/workflows/server.yml
# SECURITY.md
# docs/backend/SYCL.md
# examples/model-conversion/README.md
# examples/model-conversion/scripts/embedding/compare-embeddings-logits.sh
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/matmul-ops.c
# tests/CMakeLists.txt
# tests/test-chat.cpp
# tests/test-json-schema-to-grammar.cpp
|
2025-12-17 20:30:34 +08:00 |
|
Concedo
|
1e083d9c8b
|
integrate autofit for upstream, removed forceversion
|
2025-12-17 18:42:47 +08:00 |
|
Concedo
|
cacfa37611
|
wip
|
2025-12-17 16:04:45 +08:00 |
|
Concedo
|
fd0d0cab03
|
move pipeline parallelism to a --pipelineparallel launch flag
|
2025-12-11 21:03:41 +08:00 |
|
Concedo
|
34634aef1b
|
tweak to smartcache for contextshifting
|
2025-12-10 20:08:11 +08:00 |
|
Concedo
|
8a18e094f5
|
added smartcaching implementation inspired from Pento95 (+2 squashed commit)
Squashed commit:
[fcc498688] wip basic smart caching test
[b6e8b2577] wip basic smart caching test
|
2025-12-10 18:00:03 +08:00 |
|
Concedo
|
b867b67e7e
|
added mechanics for a full clear if fast forward is not used, this should help recover from bad states
|
2025-12-05 16:43:37 +08:00 |
|