ouroboros/devtools
Ouroboros 41c8c0fc7a devtools(gaia): pin codex reasoning effort via GAIA_CODEX_EFFORT
The codex_solver shelled `codex exec` with no reasoning-effort override, so
runs used codex's own config.toml default (xhigh). For an apples-to-apples
cross-harness comparison with Ouroboros, add GAIA_CODEX_EFFORT (default "high")
and inject `-c model_reasoning_effort=<effort>` into the exec command; record
the chosen effort in the result dict and sample metadata. Mirrors the existing
GAIA_CLAUDE_EFFORT knob in claude_code_solver. README documents the knob.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-27 20:59:58 +03:00
..
benchmarks devtools(gaia): pin codex reasoning effort via GAIA_CODEX_EFFORT 2026-06-27 20:59:58 +03:00
__init__.py feat(devtools-benchmarks): add official benchmark harnesses and workspace executor 2026-06-06 12:03:30 +03:00
README.md feat(devtools-benchmarks): add official benchmark harnesses and workspace executor 2026-06-06 12:03:30 +03:00

Ouroboros Devtools

devtools/ contains operator-side and benchmark support code that should be versioned with Ouroboros without becoming part of the runtime core.

Rules:

  • Generated logs, datasets, run outputs, Docker layers, and secrets do not live here.
  • Default benchmark outputs go under /Users/anton/Ouroboros/bench_runs/.
  • Runtime modules must not import devtools.
  • This is not an immune-system bypass: touched files are reviewed normally.
  • Promote code out of devtools only through a separate reviewed runtime plan.