BigMoeOnEdge/scripts
Helldez ecd7b56834
feat(bench): community benchmarks: one-command host protocol, issue form, results table (#176)
Every published number comes from one phone and one laptop. This adds what a
contributor needs to add a row from hardware we do not own, without reading code:

- scripts/bench-report.sh runs the fixed README protocol on any Linux/macOS host
  (256 greedy tokens, the reference prompt, auto cache, 4 lanes, overlap, dense
  weights out of the page cache), records CPU / RAM / drive and the drive's
  measured O_DIRECT rate at 512 KiB requests from the model file itself, and
  prints the two markdown tables a report needs. Every figure is read from the
  CSV `# summary` trailer by key name.
- .github/ISSUE_TEMPLATE/benchmark-report.yml collects hardware, model, engine
  version and the pasted tables; tok/s alone is not accepted as a row.
- docs/community-benchmarks.md holds the protocol, the hardware wanted and why,
  the reference models in the catalog quants, the meaning of each column, and
  the results table seeded with the README rows.
- README, CONTRIBUTING and the docs index point at it.
2026-08-27 21:29:19 +02:00
..
bench-analyze.py chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-lib.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-matrix-rework.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-matrix.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-pr23-c2000.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-pr23-summary.py chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-prefetch.ps1 chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00
bench-report.sh feat(bench): community benchmarks: one-command host protocol, issue form, results table (#176) 2026-08-27 21:29:19 +02:00
bench-run.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
bench-warmonly.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
build-android.ps1 build(android): stage an explicit library list, and force GGML_OPENCL off (#124) 2026-07-28 15:10:49 +02:00
build-host.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
decode-analyze.py feat(trace): add layer-granularity compute trace (--compute-trace-layers) 2026-07-19 09:21:39 +02:00
gptoss-matrix.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
gptoss-mmap.sh Mark the two doc-invoked host scripts executable (#164) 2026-08-25 11:41:24 +02:00
make-tiny-moe.py feat(moe): stream split multi-shard ggufs natively + DeepSeek V4 Flash recipe (#144) 2026-08-01 23:34:35 +02:00
route-analyze.py feat(moe): --drop-cold-experts — spend quality only where it buys I/O (#95) 2026-07-22 17:21:55 +02:00
route-drop-replay.py feat(moe): --drop-cold-experts — spend quality only where it buys I/O (#95) 2026-07-22 17:21:55 +02:00
route-replay.py fix(tools): make the diagnostics fail instead of reporting a confident wrong number 2026-07-20 12:25:58 +02:00
route-viewer.py feat(scripts): route-viewer.py — read a route trace without a spreadsheet 2026-07-15 09:52:09 +02:00
trace_io.py chore(scripts): consolidate the bench drivers, prune the retired framing 2026-07-17 10:41:13 +02:00