WFGY/ProblemMap/GlobalFixMap/Retrieval/checklists/traceability_gate.md

4.1 KiB
Raw Blame History

Traceability Gate Checklist

Purpose: enforce cite then explain with a minimal, verifiable payload contract.


Required fields per snippet

  • snippet_id unique within the corpus
  • section_id stable anchor for the document
  • source_url resolvable or a content hash if private
  • offsets byte or char range within the source
  • tokens token range used by the model

Contract details:
Retrieval traceability · Data contracts


Schema example

{
  "snippet_id": "sn_9f3a",
  "section_id": "sec_2.3_hydraulics",
  "source_url": "https://example.org/handbook/2024/chap2#sec-3",
  "offsets": {"start": 18342, "end": 18897},
  "tokens": {"start": 1205, "end": 1248}
}

Gate checks

  • Each answer references at least one snippet with all required fields.
  • Offsets resolve back to exactly the cited text.
  • Section anchors stable across builds. Hash or ID diff is logged.
  • Duplicate or near duplicate snippets collapsed before ranking.
  • Formatter and export steps do not rename required fields.
  • On failure, publish is blocked and the pipeline returns a structured error.

Refs: Duplication and near duplicate collapse


Acceptance targets

  • 100 percent of published answers pass the schema check.
  • For the gold set, human spot check of 20 answers finds zero broken citations.
  • ΔS(question, cited_snippet) ≤ 0.45 on average.

Minimal policy snippet

Policy:
- Answer only after citing snippets with {snippet_id, section_id, source_url, offsets, tokens}.
- If no snippet qualifies, return "insufficient evidence" with the top 3 candidate snippets and exit.

🔗 Quick-Start Downloads (60 sec)

Tool Link 3-Step Setup
WFGY 1.0 PDF Engine Paper 1 Download · 2 Upload to your LLM · 3 Ask “Answer using WFGY + <your question>”
TXT OS (plain-text OS) TXTOS.txt 1 Download · 2 Paste into any LLM chat · 3 Type “hello world” — OS boots instantly

Explore More

Layer Page What its for
Proof WFGY Recognition Map External citations, integrations, and ecosystem proof
⚙️ Engine WFGY 1.0 Original PDF tension engine and early logic sketch (legacy reference)
⚙️ Engine WFGY 2.0 Production tension kernel for RAG and agent systems
⚙️ Engine WFGY 3.0 TXT based Singularity tension engine (131 S class set)
🗺️ Map Problem Map 1.0 Flagship 16 problem RAG failure taxonomy and fix map
🗺️ Map Problem Map 2.0 Global Debug Card for RAG and agent pipeline diagnosis
🗺️ Map Problem Map 3.0 Global AI troubleshooting atlas and failure pattern map
🧰 App TXT OS .txt semantic OS with fast bootstrap
🧰 App Blah Blah Blah Abstract and paradox Q&A built on TXT OS
🧰 App Blur Blur Blur Text to image generation with semantic control
🏡 Onboarding Starter Village Guided entry point for new users

If this repository helped, starring it improves discovery so more builders can find the docs and tools.
GitHub Repo stars