mirror of
https://github.com/razzant/ouroboros.git
synced 2026-08-05 00:29:46 +00:00
0a091cc9d1
Commit 3/3 of the bench post-mortem sprint (plan smooth-skipping-charm; commits 1-2 = bf8bde7 v6.54.3, ef786bb v6.54.4). Minor bump per plan. Shared bench-template scaffold defaults, disclosed in the benchmarks index and per-bench METHODOLOGY files: OUROBOROS_MAX_WORKERS=4 (same-model decomposition slots within one task, never best-of-N; TB 2->4, GAIA --max-workers default 1->4 with explicit 1 as the strict-baseline ablation and the quality-profile silent 1->5 bump removed, SWE-pro 5->4), OUROBOROS_SAFETY_MODE=light (disposable jails; deterministic guards stay), RUNTIME_MODE=pro for container benches (GAIA deliberately stays light: its solver runs unisolated against a live repo), and claude_code_edit disabled in every bench solve task (single-model harness measurement). TB raises _DEADLINE_SAFETY_SEC 30->105 from measured finalization overhead, mirrors the registry _WEB_TOOLS denylist (youtube_transcript drift fixed, pinned by a sync test), and the README pins why --all-model keeps review single-model. ProgramBench e2e runner ported from the colleague's tree, adapted to our APIs: metadata.budget_profile onto the v6.54.4 contract (footer keys dropped, reserve pct unit-fixed 0.15->15), solve-model preflight through migrate_model_value (fail-fast on direct-route legacy ids), atomic per-instance checkpoints with honored reattach (client poll timeout leaves the executor alive; the next run skips seed/start and reattaches), explicit payload-status terminal detection, denominator-preserving ledgers (skipped_existing rows; skipped = successful for exit code), source-only submissions (both root binaries excluded by name), idempotent workspace normalization shared by the prepare-only flow. New continual_learning/ launcher wraps the EXTERNAL CL-Bench runner (nothing vendored; fails loudly with obtain instructions), strict-sequential guard (parallel opt-in is exclusively-stateless-bridge only), standard-path pointer rows keep the ledger denominator, fidelity gaps of the pinned external adapter recorded and warned. OSWorld aligned to the official 2.0 protocol (pinned OSWorld-V2@c261cb57, 500-step default, show_result.py layout, official traj rows), bridge-level final_answer capture with VM-state-only prompting, preflight verifies the target server's effective scaffold settings via /api/settings (env cannot configure a --url server) and refuses the live desktop URL without an explicit flag. LifelongAgentBench documented as blocked (its 100% run was a no-gold-oracle artifact). Carriers synced to 6.55.0. Review: 6 triad+scope rounds to a fully clean verdict (16 confirmed criticals fixed, each with a regression test); gemini/opus clean in all rounds. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
31 lines
1.1 KiB
JSON
31 lines
1.1 KiB
JSON
{
|
|
"OPENROUTER_API_KEY": "",
|
|
"OPENAI_API_KEY": "",
|
|
"ANTHROPIC_API_KEY": "",
|
|
"OUROBOROS_MODEL": "anthropic/claude-sonnet-4.6",
|
|
"OUROBOROS_MODEL_HEAVY": "anthropic/claude-sonnet-4.6",
|
|
"OUROBOROS_MODEL_LIGHT": "anthropic/claude-sonnet-4.6",
|
|
"OUROBOROS_MODEL_FALLBACKS": "anthropic/claude-sonnet-4.6",
|
|
"OUROBOROS_REVIEW_MODELS": "anthropic/claude-sonnet-4.6,anthropic/claude-sonnet-4.6,anthropic/claude-sonnet-4.6",
|
|
"OUROBOROS_SCOPE_REVIEW_MODEL": "anthropic/claude-sonnet-4.6",
|
|
"OUROBOROS_SCOPE_REVIEW_MODELS": "anthropic/claude-sonnet-4.6",
|
|
"OUROBOROS_REVIEW_ENFORCEMENT": "blocking",
|
|
"OUROBOROS_RUNTIME_MODE": "advanced",
|
|
"OUROBOROS_SAFETY_MODE": "light",
|
|
"OUROBOROS_MAX_WORKERS": 4,
|
|
"OUROBOROS_POST_TASK_EVOLUTION": "false",
|
|
"OUROBOROS_EFFORT_TASK": "low",
|
|
"OUROBOROS_OR_PROVIDER": "resilience",
|
|
"TOTAL_BUDGET": 60.0,
|
|
"CLBENCH_SOLVE_DISABLED_TOOLS": [
|
|
"vlm_query",
|
|
"analyze_screenshot",
|
|
"view_image",
|
|
"browse_page",
|
|
"browser_action",
|
|
"web_search",
|
|
"youtube_transcript",
|
|
"send_photo",
|
|
"claude_code_edit"
|
|
]
|
|
}
|