openclaw/qa
Firas Alswihry a9eaf0c993
test(qa-lab): add personal no-fake-progress scenario (#83824)
Summary:
- The PR adds a personal-agent QA-Lab no-fake-progress scenario, registers it in the personal-agent pack, teaches mock-openai the scripted path, and updates focused tests, docs, and changelog.
- Reproducibility: not applicable. This PR adds QA coverage rather than reporting a current-main bug; the branch supplies concrete after-patch QA-Lab/mock-openai commands and copied pass output.

Automerge notes:
- PR branch already contained follow-up commit before automerge: test(qa-lab): add personal no-fake-progress scenario

Validation:
- ClawSweeper review passed for head 95d2e46288.
- Required merge gates passed before the squash merge.

Prepared head SHA: 95d2e46288
Review: https://github.com/openclaw/openclaw/pull/83824#issuecomment-4483439200

Co-authored-by: Firas Alswihry <itzfiras@gmail.com>
Co-authored-by: clawsweeper <274271284+clawsweeper[bot]@users.noreply.github.com>
Co-authored-by: clawsweeper[bot] <274271284+clawsweeper[bot]@users.noreply.github.com>
Approved-by: takhoffman
Co-authored-by: takhoffman <781889+takhoffman@users.noreply.github.com>
2026-05-19 01:16:00 +00:00
..
convex-credential-broker chore(lint): remove underscore-dangle allow list (#83542) 2026-05-18 14:56:06 +01:00
scenarios test(qa-lab): add personal no-fake-progress scenario (#83824) 2026-05-19 01:16:00 +00:00
frontier-harness-plan.md test(openai): cover GPT-5.5 defaults 2026-04-23 20:19:15 +01:00
new-scenarios-2026-04.md
README.md Add WhatsApp live QA lane (#77704) 2026-05-05 12:09:28 -07:00
scenarios.md QA: organize scenarios by theme 2026-04-17 11:03:47 -04:00

QA Scenarios

Seed QA assets for the private qa-lab extension.

Files:

  • scenarios/index.md - canonical QA scenario pack, kickoff mission, and operator identity.
  • scenarios/<theme>/*.md - one runnable scenario per markdown file.
  • frontier-harness-plan.md - big-model bakeoff and tuning loop for harness work.
  • convex-credential-broker/ - standalone Convex v1 lease broker for pooled live credentials.

Key workflow:

  • qa suite is the executable frontier subset / regression loop.
  • qa manual is the scoped personality and style probe after the executable subset is green.
  • qa coverage prints the scenario coverage inventory from scenario frontmatter.

Operator workflows:

  • Use the openclaw-qa-testing skill for QA Lab live lanes, Convex credential pool operations, and WhatsApp live credential setup/replacement.

Keep this folder in git. Add new scenarios here before wiring them into automation.