openclaw/qa
Colin Johnson d5a27b0b96
test: add QA Lab UX Matrix evidence scenario (#94306)
* test: add qa lab ux matrix script scenario

* fix(qa-lab): annotate UX Matrix producer catch callback as unknown for oxlint

---------

Co-authored-by: Dallin Romney <dallinromney@gmail.com>
2026-06-18 14:10:06 -07:00
..
convex-credential-broker docs: document repository scripts 2026-06-04 20:52:50 -04:00
scenarios test: add QA Lab UX Matrix evidence scenario (#94306) 2026-06-18 14:10:06 -07:00
copilot-capabilities.md feat(copilot): add GitHub Copilot agent runtime 2026-05-29 05:15:22 +01:00
frontier-harness-plan.md test(openai): cover GPT-5.5 defaults 2026-04-23 20:19:15 +01:00
new-scenarios-2026-04.md feat(qa): execute ten new repo-backed scenarios 2026-04-06 04:28:33 +01:00
README.md Convert QA scenarios to YAML files (#92915) 2026-06-14 17:31:18 -07:00
scenarios.md Convert QA scenarios to YAML files (#92915) 2026-06-14 17:31:18 -07:00

QA Scenarios

Seed QA assets for the private qa-lab extension.

Files:

  • scenarios/index.yaml - canonical QA scenario pack, kickoff mission, and operator identity.
  • scenarios/<theme>/*.yaml - one runnable scenario per YAML file.
  • frontier-harness-plan.md - big-model bakeoff and tuning loop for harness work.
  • convex-credential-broker/ - standalone Convex v1 lease broker for pooled live credentials.

Key workflow:

  • qa suite is the executable frontier subset / regression loop.
  • qa manual is the scoped personality and style probe after the executable subset is green.
  • qa coverage prints the scenario coverage inventory from scenario YAML.

Operator workflows:

  • Use the openclaw-qa-testing skill for QA Lab live lanes, Convex credential pool operations, and WhatsApp live credential setup/replacement.

Keep this folder in git. Add new scenarios here before wiring them into automation.