codeburn/docs/release-acceptance/cases.csv
Aditya Vikram Singh 9a929c87ab
test: add repeatable release acceptance ledger (#1164)
* test: add repeatable release acceptance ledger

* ci: gate desktop typecheck tests and build
2026-08-28 15:02:07 -07:00

8.2 KiB

1idphasepersonasurfacetestmethodautomationevidencethresholdblockingowner
2RA-PROV-001provenancebothallAuthoritative remote SHA and ancestry pinnedscriptfullprovenance.jsonexact matchyesrelease
3RA-PROV-002provenancebothallCLI Desktop Menu Bar manifest versions agreescriptfullprovenance.jsonno unexplained driftyesrelease
4RA-PROV-003provenancebothallArtifact hashes and build inputs recordedscriptfullprovenance.jsonall distributables hashedyesrelease
5RA-PROV-004provenancebothallBuild leaves tracked worktree cleanscriptfullrun.jsonno tracked mutationyesbuild
6RA-INV-001inventorybothallPATH npm bun brew and app-bundle inventoryshellpartialresidue.csvno unintended duplicateyesrelease
7RA-INV-002inventorybothallProcesses helpers mounted images and launch itemsshellpartialresidue.csvno stale active copyyesrelease
8RA-INV-003inventorybothallConfig cache state and reversible backup sizesshellpartialresidue.csvbackup verifiedyesrelease
9RA-BUILD-001buildACLIRoot tests and lock testsscriptfullautomated-results.jsonall non-quarantined passyesengineering
10RA-BUILD-002buildADesktopDesktop tests typecheck and packagescriptpartialautomated-results.jsonpassyesdesktop
11RA-BUILD-003buildAMenu BarSwift tests universal package and deployment targetscriptfullautomated-results.jsonpassyesmenubar
12RA-BUILD-004buildAWebProduction dashboard buildscriptfullautomated-results.jsonpassyesweb
13RA-INSTALL-001installACLIPacked artifact install version and process pathshellpartialinstall.jsonexact candidateyesrelease
14RA-INSTALL-002installADesktopTwo uninstall reinstall cyclescomputer-usemanualclick-through.csvexact candidate twiceyesdesktop
15RA-INSTALL-003installAMenu BarTwo uninstall reinstall cyclescomputer-usemanualclick-through.csvexact candidate twiceyesmenubar
16RA-INSTALL-004installAmacOSSigning entitlements and Gatekeepershellpartialinstall.jsonrelease policy satisfiedyesrelease
17RA-INSTALL-005installAallQuit relaunch logout login persistencecomputer-usemanualclick-through.csvone healthy copyyesrelease
18RA-A-001onboardingADesktopZero-state onboarding every page and choicecomputer-usemanualclick-through.csvall destinations inspectedyesproduct
19RA-A-002onboardingADesktopTelemetry opt-out is clear and honoredcomputer-usemanualscreenshotzero remote transmissionyesprivacy
20RA-A-003onboardingADesktopEmpty overview is honest and non-evaluativecomputer-usemanualscreenshotno false grade or totalsyesproduct
21RA-A-004onboardingACLIHelp invalid options no-data and first outputshellfullautomated-results.jsonactionable bounded outputyescli
22RA-UI-001clickthroughADesktopEvery primary destinationcomputer-usemanualclick-through.csvclicked and inspectedyesdesktop
23RA-UI-002clickthroughADesktopEvery settings page control and disclosurecomputer-usemanualclick-through.csvclicked and inspectedyesdesktop
24RA-UI-003clickthroughADesktopPeriods custom dates providers filters sorts searchcomputer-usemanualclick-through.csvcorrect stateyesdesktop
25RA-UI-004clickthroughADesktopDetail drawer back forward refresh and shortcutscomputer-usemanualclick-through.csvcorrect stateyesdesktop
26RA-UI-005clickthroughADesktopResize zoom light dark system keyboard-onlycomputer-usemanualclick-through.csvno inaccessible contentyesaccessibility
27RA-UI-006clickthroughADesktopAccessibility roles labels focus ordercomputer-usemanualclick-through.csvno critical gapyesaccessibility
28RA-UI-007clickthroughAMenu BarStatus item visible and left-click popovercomputer-usemanualclick-through.csvgenuine click and state inspectionyesmenubar
29RA-UI-008clickthroughAMenu BarRight-click menu settings refresh quitcomputer-usemanualclick-through.csvgenuine click and state inspectionyesmenubar
30RA-UI-009clickthroughAMenu BarAll periods modes providers disclosurescomputer-usemanualclick-through.csvcorrect stateyesmenubar
31RA-UI-010clickthroughAWebFirst paint routes periods modes providersbrowsermanualclick-through.csvclicked and inspectedyesweb
32RA-UI-011clickthroughAWebBack forward reload resize themes device searchbrowsermanualclick-through.csvcorrect stateyesweb
33RA-PERF-001performanceACLIGolden packed cold three trialsshellpartialtimings.csvidentical totals and baseline comparisonyesperformance
34RA-PERF-002performanceACLIGolden packed warm five trialsshellpartialtimings.csvidentical totals and baseline comparisonyesperformance
35RA-PERF-003performanceADesktopVisible and settled launchshell+computer-usemanualtimings.csvprogress and product SLAyesperformance
36RA-PERF-004performanceAWebFirst useful paint and warm actionsbrowsermanualtimings.csvflag feedback over 250ms or navigation over 1snoperformance
37RA-PERF-005performanceBDesktopHeavy cold first useful complete peak CPU RSSshell+computer-usemanualtimings.csvprogress plus product SLAyesperformance
38RA-PERF-006performanceBallWarm navigation and detail actionscomputer-usemanualtimings.csvflag warm action over 1snoperformance
39RA-ACC-001accuracyAallGolden calls sessions and token familiesindependent-calculationpartialaccuracy.csvexact equalityyescorrectness
40RA-ACC-002accuracyAallGolden cost priced unpriced estimatedindependent-calculationpartialaccuracy.csvexact sub-cent semanticsyescorrectness
41RA-ACC-003accuracyAallUTC local boundaries custom datesindependent-calculationpartialaccuracy.csvexact documented boundaryyescorrectness
42RA-ACC-004accuracyAallDuplicate resume subagent attributionindependent-calculationpartialaccuracy.csvexact invariantyescorrectness
43RA-ACC-005accuracyAallIdentical filters across CLI TUI Desktop Menu Bar Webmixedmanualaccuracy.csvexact equalityyescorrectness
44RA-ACC-006accuracyBallThirty raw sessions over five providers or all availableindependent-samplemanualaccuracy.csvevery mismatch investigatedyescorrectness
45RA-ACC-007accuracyBallPlans quotas cache reasoning delegated casesindependent-samplemanualaccuracy.csvsemantics reconciledyescorrectness
46RA-REC-001recoveryACLIOffline startup and cached datashellpartialrecovery.jsonbounded honest stateyesreliability
47RA-REC-002recoveryACLIUnreadable provider file copyshellpartialrecovery.jsonactionable degraded warningyesreliability
48RA-REC-003recoveryACLIExclusive locked SQLite copyshellpartialrecovery.jsonnever silently emptyyescorrectness
49RA-REC-004recoveryAallCorrupt and interrupted cache copyshellpartialrecovery.jsonself-heal or actionable erroryesreliability
50RA-REC-005recoveryACLIConcurrent runs and identical totalsshellpartialrecovery.jsonno corruption or mismatchyesreliability
51RA-REC-006recoveryACLISIGINT then restartshellpartialrecovery.jsonclean bounded recoveryyesreliability
52RA-REC-007recoveryADesktopQuit removes all owned processescomputer-use+shellmanualrecovery.jsonwithin product SLAyesdesktop
53RA-REC-008recoveryAMenu BarSleep wake display sleep and relaunchcomputer-use+shellmanualrecovery.jsonitem and refresh recoveryesmenubar
54RA-REC-009recoveryAallStale cache and live corpus changemixedmanualrecovery.jsonno stale success claimyescorrectness
55RA-REC-010recoveryAallNo-data and unavailable-provider distinctionmixedmanualrecovery.jsonno false empty resultyescorrectness
56RA-RES-001residuebothallExactly one intended active install per surfaceshellpartialresidue.csvno duplicate path or processyesrelease
57RA-RES-002residuebothallCompatible history config restored and caches rebuiltshellpartialresidue.csvverifiedyesrelease
58RA-RES-003residuebothallBackups inert checksummed and documentedshellpartialresidue.csvnot on PATH or activeyesrelease
59RA-RES-004residuebothallNo mounted image installer helper or stale login itemshellpartialresidue.csvnoneyesrelease
60RA-REV-001reviewbothallIndependent finding reproduction and code reviewreviewmanualrun.jsonsign-off recordedyesquality
61RA-REV-002reviewbothallAffected-machine proof for environment-specific defectexternal-testmanualrun.jsonreporter evidenceconditionalquality