BigMoeOnEdge/scripts
Raffaele 1d37057fac
Some checks failed
ci / changes (push) Has been cancelled
ci / host-windows (push) Has been cancelled
ci / host-macos (push) Has been cancelled
ci / android-apk (push) Has been cancelled
ci / format (push) Has been cancelled
ci / host-linux (push) Has been cancelled
feat: --decide, choose from a list from one prefill, with no decode (#201)
A session opened with --decide answers which of a list of choices the model would pick, read from
the next-token distribution after one prefill, with no decode. The state after a shared prefix is
kept and restored when the next prefix extends it. Android app: a Choose from options switch.

With --prefill-device, a decision is prefilled by the chat turn's placement rule and keeps no
prefix state: llama.cpp saves a sequence through KV views that do not follow the moved model state
(gate G18g). Also fixes the engine version, stuck at 0.23.0 since 0.24.0. App 0.27.0 (42).
2026-09-28 12:01:25 +02:00
..
bench-analyze.py chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-lib.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-matrix-rework.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-matrix.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-pr23-c2000.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-pr23-summary.py chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-prefetch.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-report.sh fix(scripts): bench-report model size and storage probe (du on the raw path) (#194) 2026-08-31 12:48:09 +02:00
bench-run.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
bench-warmonly.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
build-android.ps1 build(android): stage an explicit library list, and force GGML_OPENCL off (#124) 2026-07-28 15:10:49 +02:00
build-hexagon-android.sh feat: prefill on the NPU, decode on the CPU (--prefill-device), in the release APK (#200) 2026-09-28 09:52:46 +02:00
build-host.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
decode-analyze.py feat(trace): add layer-granularity compute trace (--compute-trace-layers) 2026-07-19 09:21:39 +02:00
gptoss-matrix.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
gptoss-mmap.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
humaneval-bench.py feat(moe): cache-aware expert substitution (--expert-substitute, experimental) and --ppl (#171) 2026-08-29 10:13:47 +02:00
inspect-hf-moe-release.py feat(moe): Qwen3.8-Flash-Next support (#172) 2026-08-28 10:07:43 +02:00
make-tiny-moe.py feat: --decide, choose from a list from one prefill, with no decode (#201) 2026-09-28 12:01:25 +02:00
route-analyze.py feat(moe): --drop-cold-experts — spend quality only where it buys I/O (#95) 2026-07-22 17:21:55 +02:00
route-drop-replay.py feat(moe): --drop-cold-experts — spend quality only where it buys I/O (#95) 2026-07-22 17:21:55 +02:00
route-replay.py fix(tools): make the diagnostics fail instead of reporting a confident wrong number 2026-07-20 12:25:58 +02:00
route-viewer.py feat(scripts): route-viewer.py — read a route trace without a spreadsheet 2026-07-15 09:52:09 +02:00
stage-hexagon-jnilibs.ps1 feat: prefill on the NPU, decode on the CPU (--prefill-device), in the release APK (#200) 2026-09-28 09:52:46 +02:00
tinymmlu-bench.py feat(moe): cache-aware expert substitution (--expert-substitute, experimental) and --ppl (#171) 2026-08-29 10:13:47 +02:00
trace_io.py chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00