WFGY/ProblemMap/GlobalFixMap/Agents_Orchestration/playbooks/playbook_agents_triage_15min.md
2025-08-27 15:17:53 +08:00

1.4 KiB
Raw Blame History

Playbook: Agents Triage in 15 Minutes

A fast path to isolate failure layers and route to the right fix.

Minute 03 Measure and log

  • Compute ΔS(question, retrieved) and ΔS(retrieved, anchor)
  • Record λ on the last three steps
  • If ΔS ≥ 0.60 stop and jump to chunking and metric checks

Minute 37 Retrieval checks

  • Verify analyzer and metric across write and read
  • Sweep k values 5, 10, 20
  • If hybrid, enable deterministic rerank
  • Open: Retrieval Playbook

Minute 710 Schema and tools

Minute 1013 Long chain stability

Minute 1315 Decide and verify

  • If metrics improved, rerun with three paraphrases
  • If not, rebuild index parameters and re-run gold tests
  • Escalate when live flips persist
    Open: Pre-Deploy Collapse