35 commits

Author	SHA1	Message	Date
Vincent Koc	4407ed19ac	fix(perf): isolate benchmark subprocess transport (#144159) ... * fix(perf): isolate benchmark subprocess transport Run transported CLI samples and their temporary state through the explicit SUT transport while preserving native measurements. Reject unsupported transported runtime RSS and profiles before launching candidate code. Punchcard-Session: coral-orchard-orchard-d4 * fix(perf): reject mixed benchmark execution modes Record evaluator-owned execution identity per suite and enforce compatible modes in comparisons, budget checks, and source summaries while preserving independent RSS semantics. Punchcard-Session: coral-orchard-orchard-d4	2026-09-11 20:28:53 +08:00
Peter Steinberger	c5882352a3	fix(bench): attribute CLI memory to the runtime process (#127746) ... * refactor(test): remove benchmark comparison test seam * fix(bench): unblock CLI memory benchmark typechecks * fix(bench): keep runtime RSS attribution opt-in --------- Co-authored-by: Vincent Koc <vincentkoc@ieee.org>	2026-09-09 16:30:50 +09:00
Peter Steinberger	74c1900e63	refactor(tooling): unify managed child process cleanup (#127480)	2026-08-21 15:43:39 -07:00
Peter Steinberger	b3248bf8f1	fix(release): authenticate performance health probes (#125453)	2026-08-17 16:54:21 -07:00
Dallin Romney	c8ee50165e	fix(ci): keep frozen CLI probes compatible (#117925) ... * fix(ci): support older CLI performance probes * fix(release): make trusted CLI benchmark self-contained * style: format trusted CLI benchmark parser	2026-08-02 18:15:35 +08:00
Vincent Koc	825a794672	fix(perf): retain startup benchmark warmups (#117649)	2026-08-02 07:43:22 +08:00
Vincent Koc	6531ca91f4	fix(perf): separate warm and first-device health probes (#117525) ... * fix(perf): separate warm and first-device health probes * fix(perf): configure first-device health probe * fix(perf): require connected health probes * fix(perf): preserve generic health benchmark state	2026-08-02 03:30:17 +08:00
Peter Steinberger	e580275464	feat(tooling): enforce noUncheckedIndexedAccess in the scripts lane (NUIA phase 5) (#105180) ... * feat(tooling): enforce noUncheckedIndexedAccess in the scripts lane Burns down all 153 scripts-lane errors (bench aggregation, release checks, i18n inventories, argv indexing) and flips the flag in tsconfig.scripts.json. Direct-Node-executed release harness scripts use local narrowing instead of workspace imports, which do not resolve under plain node execution. Benchmark measured loops untouched. * fix(scripts): import expect helpers via relative package sources tsconfig path aliases resolve from cwd under tsx, so release wrapper scripts running against old release target cwds could not resolve @openclaw/normalization-core (not a linked root dependency). Relative package-source imports match the established pattern on the adjacent lines and are cwd-independent; old-target planning verified directly.	2026-07-12 10:17:00 +01:00
Peter Steinberger	1f484a8dbd	test: speed up and stabilize full suite	2026-07-05 08:00:23 -04:00
Vincent Koc	524e19726f	fix(qa): reject duplicate cli bench controls	2026-06-23 17:01:42 +02:00
Vincent Koc	8e6624cb6c	fix(qa): reject duplicate sibling bench cases	2026-06-23 16:20:46 +02:00
Anson_H	3895c9341b	perf(cli): speed up precomputed command help startup ... * perf: speed up precomputed command help * perf: precompute sessions and tasks help * Speed up precomputed command help startup * Speed up precomputed command help startup --------- Co-authored-by: Zeheng Huang <153708448+hunjaiboy@users.noreply.github.com> Co-authored-by: openclaw-clownfish[bot] <280122609+openclaw-clownfish[bot]@users.noreply.github.com>	2026-06-22 21:27:47 +08:00
Vincent Koc	4684bbba97	fix(scripts): reject short flag values in benchmark CLIs	2026-06-21 22:11:19 +02:00
Vincent Koc	602bc0baa9	fix(bench): clean timed-out sample process groups	2026-06-20 12:31:47 +02:00
Vincent Koc	56c0405018	fix(test): guard benchmark qa cli args	2026-06-20 02:13:13 +02:00
clawsweeper[bot]	2e0dfda462	test(perf): compare saved CLI startup benchmarks (#94812) ... Summary: - Adds saved CLI startup benchmark report comparison flags to `scripts/bench-cli-startup.ts`, plus JSON output coverage and changed-target routing expectations for the new test-helper importer. - PR surface: Tests +77, Other +109. Total +186 across 4 files. - Reproducibility: not applicable. as a feature/tooling PR. The prior PR defects were source-proven in review comments and the current head addresses them; I did not run local tests because this review was read-only. Automerge notes: - Ran the ClawSweeper repair loop before final review. - Included post-review commit in the final squash: test(perf): compare saved CLI startup benchmarks Validation: - ClawSweeper review passed for head 1afa110f1b. - Required merge gates passed before the squash merge. Prepared head SHA: 1afa110f1b Review: https://github.com/openclaw/openclaw/pull/94812#issuecomment-4748785428 Co-authored-by: clawsweeper <274271284+clawsweeper[bot]@users.noreply.github.com> Co-authored-by: Felix Isaac Lim <38658663+FelixIsaac@users.noreply.github.com>	2026-06-19 09:37:47 +00:00
Vincent Koc	77f8b16716	fix(test): fail startup bench missing RSS samples	2026-06-06 20:39:07 +02:00
Vincent Koc	59365959d3	fix(test): fail startup bench timed-out samples	2026-06-06 20:03:47 +02:00
Peter Steinberger	b8d08f0cfd	docs: document repository scripts	2026-06-04 20:52:50 -04:00
Vincent Koc	286e5ffe07	test(startup): make cli startup budgets arch-aware	2026-06-03 09:50:04 -07:00
Vincent Koc	9ca791288c	fix(scripts): parse startup bench gateway ports	2026-05-29 04:39:37 +02:00
Peter Steinberger	f99259d25c	fix(perf): preserve gateway health benchmark auth	2026-05-28 20:29:24 +01:00
Peter Steinberger	3d89f493ba	fix(release): port 2026.5.27 fixes	2026-05-28 14:25:01 +01:00
Vincent Koc	d10d30c5fa	fix(test): harden startup benchmark harness	2026-05-28 06:53:58 +02:00
Vincent Koc	d1577a2ff2	fix(perf): reject invalid startup bench counts	2026-05-28 03:48:55 +02:00
Vincent Koc	8c6da93fdf	fix(test): fail startup bench on bad samples	2026-05-27 11:46:02 +02:00
Vincent Koc	94f3ecae9a	perf(cli): route plugin list json directly	2026-05-14 16:29:21 +08:00
Vincent Koc	8717525fbc	test(cli): cover parent startup budgets	2026-05-14 16:18:26 +08:00
Vincent Koc	97283f0a2e	test(cli): add response-time contract for CLI surfaces	2026-05-10 23:06:28 +08:00
Peter Steinberger	25ca5cc8df	ci: add source performance probes	2026-05-02 17:46:10 +01:00
Peter Steinberger	78577ac147	fix: route tasks json through lean cli path	2026-04-27 12:13:51 +01:00
Gustavo Madeira Santana	47136536c8	tests: use multi-sample CLI startup baselines	2026-03-30 22:35:50 -04:00
Gustavo Madeira Santana	68e49fa791	tests: standardize CLI startup benchmarks	2026-03-30 22:15:56 -04:00
Vincent Koc	38da2d076c	CLI: add root --help fast path and lazy channel option resolution (#30975) ... * CLI argv: add strict root help invocation guard * Entry: add root help fast-path bootstrap bypass * CLI context: lazily resolve channel options * CLI context tests: cover lazy channel option resolution * CLI argv tests: cover root help invocation detection * Changelog: note additional startup path optimizations * Changelog: split startup follow-up into #30975 entry * CLI channel options: load precomputed startup metadata * CLI channel options tests: cover precomputed metadata path * Build: generate CLI startup metadata during build * Build script: invoke CLI startup metadata generator * CLI routes: preload plugins for routed health * CLI routes tests: assert health plugin preload * CLI: add experimental bundled entry and snapshot helper * Tools: compare CLI startup entries in benchmark script * Docs: add startup tuning notes for Pi and VM hosts * CLI: drop bundled entry runtime toggle * Build: remove bundled and snapshot scripts * Tools: remove bundled-entry benchmark shortcut * Docs: remove bundled startup bench examples * Docs: remove Pi bundled entry mention * Docs: remove VM bundled entry mention * Changelog: remove bundled startup follow-up claims * Build: remove snapshot helper script * Build: remove CLI bundle tsdown config * Doctor: add low-power startup optimization hints * Doctor: run startup optimization hint checks * Doctor tests: cover startup optimization host targeting * Doctor tests: mock startup optimization note export * CLI argv: require strict root-only help fast path * CLI argv tests: cover mixed root-help invocations * CLI channel options: merge metadata with runtime catalog * CLI channel options tests: assert dynamic catalog merge * Changelog: align #30975 startup follow-up scope * Docs tests: remove secondary-entry startup bench note * Docs Pi: add systemd recovery reference link * Docs VPS: add systemd recovery reference link	2026-03-01 14:23:46 -08:00
Vincent Koc	bdd59e0149	Scripts: add CLI startup benchmark harness	2026-03-01 12:56:56 -08:00