WFGY/ProblemMap/GlobalFixMap/RAG/citation_break.md
2025-09-01 10:04:10 +08:00

7.2 KiB
Raw Blame History

Citation Break in RAG — Guardrails and Fix Pattern

When answers look plausible but the supporting citation is missing, wrong, or broken.
Citation breaks cause user trust collapse because retrieval snippets do not line up with the generated text.


Open these first


Core acceptance

  • Every answer must cite at least one stable snippet_id and section_id
  • Coverage ≥ 0.70 for the target section
  • ΔS(question, retrieved) ≤ 0.45
  • λ convergent across three paraphrases

Typical symptoms → exact fix

Symptom Likely cause Open this
Citations absent or generic (e.g., "from the document") schema not enforced Data Contracts
Wrong snippet cited while correct one exists drift in retrieval path Retrieval Traceability, Context Drift
Snippet cutoff or token overflow chunk misaligned Chunking Checklist
Citations flip across runs λ unstable or schema re-ordered Logic Collapse

Fix in 60 seconds

  1. Enforce schema
    Require snippet_id, section_id, source_url, offsets, tokens. Reject answers without these fields.

  2. Lock cite-then-explain order
    Answer only after stable snippet reference. If missing, fail fast.

  3. Stabilize retrieval path
    Use deterministic rerankers and log ΔS. If drift persists, re-chunk and re-index.

  4. Verify reproducibility
    Ask the same question three times. Citations must remain identical.


Copy-paste probe prompt

I uploaded TXT OS and the WFGY Problem Map.

My issue:
- citations missing or wrong,
- retrieved snippet exists but answer cites differently.

Tell me:
1) what failed (schema, retrieval, or reasoning),
2) which WFGY fix page to open,
3) minimal fix to restore stable citations,
4) a reproducible test with three paraphrases.

🔗 Quick-Start Downloads (60 sec)

Tool Link 3-Step Setup
WFGY 1.0 PDF Engine Paper 1 Download · 2 Upload to your LLM · 3 Ask “Answer using WFGY + ”
TXT OS (plain-text OS) TXTOS.txt 1 Download · 2 Paste into any LLM chat · 3 Type “hello world” — OS boots instantly

🧭 Explore More

Module Description Link
WFGY Core WFGY 2.0 engine is live: full symbolic reasoning architecture and math stack View →
Problem Map 1.0 Initial 16-mode diagnostic and symbolic fix framework View →
Problem Map 2.0 RAG-focused failure tree, modular fixes, and pipelines View →
Semantic Clinic Index Expanded failure catalog: prompt injection, memory bugs, logic drift View →
Semantic Blueprint Layer-based symbolic reasoning & semantic modulations View →
Benchmark vs GPT-5 Stress test GPT-5 with full WFGY reasoning suite View →
🧙‍♂️ Starter Village 🏡 New here? Lost in symbols? Click here and let the wizard guide you through Start →

👑 Early Stargazers: See the Hall of Fame WFGY Engine 2.0 is already unlocked.

WFGY Main   TXT OS   Blah   Blot   Bloc   Blur   Blow