af9c653d87
Drop pin-baselines.mjs: pinning is a once-per-phase paste and the script hard-coded this phase's iteration-log row, so every later phase would edit by hand anyway. Replace three hand-rolled argv parsers with node:util parseArgs. Read machine facts from node:os instead of eight subprocess probes (hw.model keeps its sysctl call). Track fixture bytes with a running counter instead of re-walking the tree per file. Delete the hover proxy that measured an argv the dock never spawns, plus unused exports (ensureDir, assertAbsolute, GENERATED_FIXTURE_DIR). Fixture output is byte-identical for the same seed (verified by full tree diff against the pre-refactor generator) and all harness metrics reproduce within run-to-run noise. |
||
|---|---|---|
| .. | ||
| BASELINES.md | ||
| ITERATION-LOG.md | ||
| README.md | ||
CodeBurn performance harness (Phase 0)
Measure → change → measure. This directory is the hill: one command per metric, pinned baselines, and an append-only iteration log.
It extends the release-acceptance ledger from #1164. It does not replace that runner. scripts/release-acceptance/run.mjs stays the SHA/package gate. These scripts emit the timings.csv template shape and wait-path numbers a hostile reviewer can re-run in one command.
What is measured
| Metric | Command | What the number is | What it is not |
|---|---|---|---|
| Cold start (wait-path) | run-metric.mjs --metric cold-start-cli |
One-shot status --format menubar-json argv Desktop/Menu Bar already spawn |
Installed window show / flame in the menu bar |
| Session parse | --metric session-parse |
Cold parse of the synthetic fixture; MB/s and ms | Founder corpus (35 GB) |
| Incremental re-parse | --metric incremental-reparse |
Append two JSONL lines on the same inode, then re-run | Rewrite / inode change |
| Period switch | --metric period-switch |
Warm serve --stdio 7D/30D p50/p95 |
Installed Desktop 250 ms p95 on the live corpus |
| Dock/TUI interactions | --metric dock-tui-proxy |
Overview-refresh and view-switch wait path | Capacity Dock hover (native, never spawns this argv) or TTY TUI keys |
| Memory | --metric memory |
RSS after cold load; optional --idle-ms 3600000 |
Packaged app RSS |
Historical receipt, not this fixture: installed Desktop 0.9.21, live corpus, 2026-08-27, 7D useful summary 18286.98 ms after 30 s idle. Spec target: 250 ms p95 ready summary, zero raw reads on unchanged generation. Evidence: /Users/a/Documents/Codeburn-audits/snappy-performance-20260827T095615Z/baselines/installed-0.9.21/ui-period-baseline.json.
One-command reproduction
HOME_DIR=$(mktemp -d /tmp/codeburn-perf-XXXX)
node scripts/perf/gen-fixture.mjs --home "$HOME_DIR" --target-mb 30
node scripts/perf/run-metric.mjs --metric all --home "$HOME_DIR"
Or npm run perf:all -- --home "$HOME_DIR". To pin a new phase, paste the run's summary.json numbers into perf/BASELINES.md by hand — pinning happens once per phase and does not need a script.
The fixture is synthetic (fake /work/... paths, lorem tool payloads). Do not copy real session files into the repo or a PR. Generated bytes live under the isolated HOME, which is gitignored.
Isolation
Matches scripts/upgrade-path/run.mjs cliEnv(): isolated HOME / USERPROFILE / APPDATA / LOCALAPPDATA / CODEBURN_CACHE_DIR. The generator refuses to write under the real home.
Iteration contract
- Attack one baseline row.
- Branch
perf/<metric>-<short-name>from current main. - One change. Measure with this harness.
- Draft PR with before, after, command, fixture. Never merge from this lane.
- Append
perf/ITERATION-LOG.md(kept or reverted).
Product files this harness must not touch: src/parser.ts, src/session-cache.ts, src/dashboard.tsx, app/electron/main.ts, app/electron/cli.ts, mac/Sources/CodeBurnMenubar/**. Those surfaces have in-flight or just-landed quality work (PRs 1159–1171, open #1149/#1062/#940).