qwen-code/scripts/tests
Shaojin Wen 3cd9561c8b
fix(ci): tighten API error detection to avoid false positive on review prose (#7328)
* fix(ci): tighten API error detection to avoid false positive on review prose

The result-text classifier matched *"[API Error"* which hits review
summaries that quote the pattern in prose (e.g. reviewing PR #7247 whose
summary mentions "[API Error: ...]" and "quota … limit"). The quota
grep then fired on the coincidental "quota … limit" substring, falsely
reporting quota exhaustion on a successful review.

Require a digit after "[API Error: " so only real API error messages
(e.g. "[API Error: 429 …]") trigger the failure path.

* fix(ci): anchor API error detection on tail position, not status-code shape

The status-code glob from the previous commit would silently miss real
aborts whose message has no leading digit (Connection error, Status:
suffix, Chinese rate-limit text) — trading a loud false positive for a
silent false negative.

Anchor on position instead: an aborted run renders the API error as (or
at the very end of) the result text, while a successful review that
discusses API errors quotes them mid-prose. Checking only the last 600
bytes separates the two without constraining the error message format.

Also adds fixtures for the non-digit-leading shapes and for prose
quoting a real status code mid-body, and removes a stale comment.

* fix(ci): catch aborts longer than the tail window; grep full text for quota

Add a whole-result check (case "$RESULT_TEXT" in "[API Error: "*)
alongside the tail check so errors whose body exceeds 600 bytes are
still detected — the prefix falls outside the tail window but the
result starts with it.

Move the quota grep back onto the full RESULT_TEXT so a long error
with quota wording early in the message is still classified as quota
(not downgraded to retryable).

* fix(ci): anchor abort detection on trailing shape, not byte window

Replace the prefix+tail-window split with an ends-with check: the
stream-json adapter appends the formatted API error last, so an
aborted run's result ENDS with "[API Error: …]" optionally followed
by a rate-limit guidance suffix. Strip the three known suffixes,
rtrim, then match *"[API Error: "*"]".

This catches the production abort shape (partial review + appended
error) at any error length, without a byte-window constant to tune
or leave untested. Prose that quotes the pattern mid-body keeps
writing afterwards and does not end with "]".

Adds fixtures for the production shape (appended error, long appended
error, rate-limit suffix after the bracket).

* test(ci): pin suffix sync with errorParsing.ts; document ]-ending trade-off

Add a sync test that reads RATE_LIMIT_MESSAGE_BY_AUTH from
errorParsing.ts and asserts all three suffixes appear in the
workflow — prevents silent drift if someone rewords one.

Add a KNOWN-limitation fixture documenting that prose ending with ]
after quoting the pattern is a false positive (accepted trade-off;
the durable fix is checking that the bot comment landed).
2026-07-20 12:41:25 +00:00
..
ai-release-notes-workflow.test.js ci(release): finalize stable releases asynchronously (#6868) 2026-07-15 00:30:51 +00:00
build-and-publish-image-workflow.test.js ci(autofix): restore sandbox image flow (#6261) 2026-07-03 15:30:58 +00:00
check-build-status.test.js fix(review): report what the transcripts prove; build the roster in one call (#7033) 2026-07-18 00:43:57 +00:00
check-i18n.test.ts fix(cli): localize approval mode UI labels (#6592) 2026-07-11 00:07:03 +00:00
chrome-extension-package.test.js fix(ci): cover release integration regressions (#5994) 2026-06-29 11:54:11 +00:00
ci-flaky-rerun-workflow.test.js feat(ci): add automated PR failure patrol (#6766) 2026-07-15 00:51:11 +00:00
ci-flaky-rerun.test.js feat(ci): auto-open a deflake fix issue for confirmed flaky tests (#7231) 2026-07-19 16:49:29 +00:00
clean-package-build-artifacts.test.js test(core): stabilize file history eviction test (#6637) 2026-07-10 06:39:52 +00:00
cli-entry.test.js fix(review): report what the transcripts prove; build the roster in one call (#7033) 2026-07-18 00:43:57 +00:00
comment-attachment-guard-workflow.test.js ci: add suspicious comment attachment guard (#6599) 2026-07-10 09:40:54 +00:00
dev.test.js fix(review): report what the transcripts prove; build the roster in one call (#7033) 2026-07-18 00:43:57 +00:00
generate-changelog.test.js feat(release): generate AI-assisted release notes (#6756) 2026-07-12 13:00:22 +00:00
generate-release-notes.test.js feat(release): generate AI-assisted release notes (#6756) 2026-07-12 13:00:22 +00:00
get-release-version-python-sdk.test.js feat(sdk-python): add network timeouts to release version helper (#3833) 2026-05-05 19:25:00 +08:00
get-release-version.test.js fix(scripts): handle missing NPM dist-tags gracefully in release versioning (#6476) (#6481) 2026-07-08 12:21:14 +00:00
install-script.test.js fix(cli): avoid updating active CLI processes (#6874) 2026-07-15 00:33:17 +00:00
issue-triage-ownership-workflow.test.js fix(ci): consolidate issue triage ownership (#7180) 2026-07-19 10:58:40 +00:00
lint.test.js revert: remove local PR verification gate (#7031) 2026-07-16 11:24:38 +00:00
main-ci-failure-issue-workflow.test.js feat(release): generate AI-assisted release notes (#6756) 2026-07-12 13:00:22 +00:00
no-ak-integration-ci.test.js fix(ci): avoid apt on self-hosted Playwright smoke (#6865) 2026-07-14 13:19:40 +00:00
package-assets.test.js fix(release): raise prepared package size limit to 96 MB (#6687) (#6691) 2026-07-11 01:01:59 +00:00
package-scripts.test.js feat(web-shell): git status chip, visual working-tree diff, and sidebar git status (#7054) 2026-07-18 10:06:07 +00:00
pr-force-push-reminder-workflow.test.js ci(autofix): run agents on dedicated ECS runners (#6207) 2026-07-03 07:40:07 +00:00
qwen-autofix-workflow.test.js test(autofix): sync workflow assertions with split model vars (#7297) 2026-07-20 07:27:24 +00:00
qwen-fleet-shepherd-workflow.test.js feat(autofix): label-driven takeover and release; fix forced-dispatch green no-op (#7165) 2026-07-19 07:35:13 +00:00
qwen-pr-review-workflow.test.js fix(ci): tighten API error detection to avoid false positive on review prose (#7328) 2026-07-20 12:41:25 +00:00
qwen-resolve-workflow.test.js feat(review): retry transient API failures once; surface quota clearly (#7233) 2026-07-19 15:27:40 +00:00
qwen-triage-workflow.test.js fix(ci): notify silent triage re-runs (#7079) 2026-07-17 16:07:10 +00:00
release-helpers.test.js refactor: extract shared release helper utilities (#3834) 2026-05-05 10:15:17 +08:00
release-sdk-workflow.test.js fix(ci): skip empty SDK release PR (#6861) 2026-07-14 13:19:42 +00:00
sandbox-command.test.js fix(scripts): avoid shell injection in sandbox command detection (#6108) 2026-07-01 16:20:40 +08:00
serve-fast-path-bundle-check.test.js perf(cli): Defer TUI runtime from ACP startup (#7182) 2026-07-19 00:10:15 +00:00
start.test.js fix(review): report what the transcripts prove; build the roster in one call (#7033) 2026-07-18 00:43:57 +00:00
test-setup.ts feat(installer): add standalone archive installation (#3776) 2026-05-11 13:25:48 +08:00
upload-aliyun-oss-assets.test.js feat(installer): add standalone hosted install and uninstall flow (#3828) 2026-05-21 11:57:10 +08:00
vitest.config.ts refactor(auth): unify provider config in core, simplify /auth as "Connect a Provider" (#4287) 2026-05-20 23:48:52 +08:00
workspaces.test.js feat(desktop): Add desktop app package with Qwen ACP SDK integration (#3778) 2026-06-11 21:57:20 +08:00