mirror of
https://github.com/QwenLM/qwen-code.git
synced 2026-08-22 07:04:58 +00:00
* fix(test): restore first-output benchmark measurement validity Anchor the post-session dwell to SSE readiness so a slow connect cannot silently reduce a dwell scenario to an immediate-prompt run, isolate the runner in its own serial vitest config, decide the Phase 1 prototype gate on the paired bootstrap CI instead of a bare difference of two P50s, and normalize every invalid timing rather than only the first. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> * fix(test): correct first-output benchmark artifact schema and simplify (#7825) Drop the bundle git commit, which resolved HEAD of whatever repository happened to contain the bundle directory rather than the revision it was built from; the harness commit and bundle hash already record provenance correctly. Rename the prompt-shape config field, which held a description of the prompt rather than the prompt itself, and bump the artifact schema for both field changes. Also remove an unreachable AB/BA balance check, fold a duplicated success predicate into one, parse the comparison-only dwell after the mode check so single mode reports the accurate error, and document the two median definitions, the compile-cache path lifetime, and the actual buffer overflow and cold/warm attribution semantics. Co-authored-by: Claude Opus 5 <noreply@anthropic.com> * fix(test): correct copyright years to 2026 (#7820) * fix(test): reuse metricForOrdinal in coldWarmProviderDeltas (#7820) * fix(test): strengthen benchmark test fixtures and align config with Vitest defaults (#7820) * test(integration): cover prototype-gate input validation guards (#7820) * fix(integration): summarize sseReadyToPromptMs metric and clarify gate error (#7820) * test(integration): pin prototype-gate artifact shape for empty deltas (#7820) * fix(integration): fail loudly on missing SSE timestamp; document sseReadyAt (#7820) Replace the non-null assertion on the dwell anchor with an explicit guard so a future path that resolves SSE readiness without recording a timestamp fails as harness_error instead of silently degrading into an immediate-prompt run that still reports its configured dwell. Also define sseReadyAt in the timestamp table and note that each metric's bootstrap seed is positional, so inserting or reordering a metric shifts later seeds and makes artifacts incomparable. * test(integration): cover findInvalidTimings in the fast CI suite (#7820) --------- Co-authored-by: Claude Opus 5 <noreply@anthropic.com> Co-authored-by: qwen-code-autofix[bot] <qwen-code-autofix[bot]@users.noreply.github.com> Co-authored-by: qwen-code-ci-bot <qwen-code-ci-bot@users.noreply.github.com> Co-authored-by: qwen-code-dev-bot <qwen-code-dev@service.alibaba.com> Co-authored-by: qwen-code-bot <qwen-code-bot@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| baselines | ||
| cli | ||
| concurrent-runner | ||
| fixtures | ||
| hook-integration | ||
| interactive | ||
| sdk-typescript | ||
| terminal-bench | ||
| terminal-capture | ||
| channel-plugin.test.ts | ||
| fake-openai-server.test.ts | ||
| fake-openai-server.ts | ||
| globalSetup.ts | ||
| test-helper.ts | ||
| test-mcp-server.ts | ||
| tsconfig.json | ||
| vitest.config.ts | ||
| vitest.firstoutput.config.ts | ||
| vitest.loadtest.config.ts | ||
| vitest.terminal-bench.config.ts | ||