mirror of
https://github.com/onestardao/WFGY.git
synced 2026-05-01 21:11:11 +00:00
1.4 KiB
1.4 KiB
Playbook: Agents Triage in 15 Minutes
A fast path to isolate failure layers and route to the right fix.
Minute 0–3 Measure and log
- Compute ΔS(question, retrieved) and ΔS(retrieved, anchor)
- Record λ on the last three steps
- If ΔS ≥ 0.60 stop and jump to chunking and metric checks
Minute 3–7 Retrieval checks
- Verify analyzer and metric across write and read
- Sweep k values 5, 10, 20
- If hybrid, enable deterministic rerank
- Open: Retrieval Playbook
Minute 7–10 Schema and tools
- Enforce snippet contract and cite-first
- Tighten tool JSON schemas
- Open: Retrieval Traceability, Data Contracts
Minute 10–13 Long chain stability
- Insert BBCR bridge and cap step depth
- Watch λ for flips on paraphrase
- Open: Context Drift, Entropy Collapse
Minute 13–15 Decide and verify
- If metrics improved, rerun with three paraphrases
- If not, rebuild index parameters and re-run gold tests
- Escalate when live flips persist
Open: Pre-Deploy Collapse