WFGY/ProblemMap/GlobalFixMap/Retrieval

Retrieval — Global Fix Map

A hub to stabilize retrieval quality across stacks, models, and stores. Use this page to route symptoms to the exact structural fix, verify with measurable targets, and keep your pipeline store agnostic.

When to use this folder

• High similarity but wrong meaning.
• Correct facts exist in the corpus but never show up.
• Citations inconsistent or missing across steps.
• Hybrid retrieval underperforms a single retriever.
• Index looks healthy while coverage remains low.

Acceptance targets

• ΔS(question, retrieved) ≤ 0.45
• Coverage of target section ≥ 0.70
• λ remains convergent across 3 paraphrases and 2 seeds
• E_resonance stays flat on long windows

---

Quick routes — core fixes

• Visual map and recovery
  → RAG Architecture & Recovery

• End to end knobs and rebuild order
  → Retrieval Playbook

• Why this snippet
  → Retrieval Traceability

• Snippet and citation schema
  → Data Contracts

• Embedding vs meaning
  → embedding-vs-semantic.md

• Chunk boundaries and audits
  → chunking-checklist.md

• Ordering control
  → rerankers.md

• Hybrid query failure
  → pattern_query_parsing_split.md

• Store fragmentation
  → pattern_vectorstore_fragmentation.md

---

Store agnostic routes in this folder

• Guardrails and probes
  → store_agnostic_guardrails.md

• Hybrid and reranker recipes
  → hybrid_reranker_recipe.md

• ΔS and λ probe pack
  → deltaS_probes.md

• Chunk alignment and anchor tests
  → chunk_alignment.md

• Retrieval eval recipes
  → retrieval_eval_recipes.md

---

Vector DBs — jump if store specific

• Family index
  → Vector DBs & Stores

• Direct routes
  → faiss.md · chroma.md · qdrant.md · weaviate.md · milvus.md · pgvector.md · redis.md · elasticsearch.md · pinecone.md · typesense.md · vespa.md

---

Symptoms → structural fixes

Symptom	Likely cause	Open this
High similarity yet wrong answer	metric or analyzer mismatch	embedding-vs-semantic.md
Correct fact never retrieved	fragmentation or missing anchors	pattern_vectorstore_fragmentation.md · chunking-checklist.md
Hybrid worse than single retriever	query parsing split or mis-weighted rerank	pattern_query_parsing_split.md · rerankers.md
Citations missing or unstable	schema not enforced	retrieval-traceability.md · data-contracts.md
Answers flip between runs	prompt header reordering or λ variance	context-drift.md · rerankers.md

---

60 second fix checklist

1. Lock metrics and analyzers
   Use a single analyzer on write and read. Verify the index metric with a small gold set.

2. Enforce the snippet contract
   Required fields: snippet_id, section_id, source_url, offsets, tokens.
   Open: data-contracts.md

3. Measure ΔS and λ
   Log ΔS(question, retrieved). Run three paraphrases and two seeds.
   Open: deltaS_probes.md

4. Sweep k and rerankers
   k in {5, 10, 20}. Try a deterministic reranker.
   Open: hybrid_reranker_recipe.md

5. Rebuild where needed
   Apply the retrieval-playbook.md sequence and re-test coverage.

---

Minimal probe pack you can paste

Context: I loaded TXT OS and WFGY pages.

Task:
- Given question "Q", log ΔS(Q, retrieved) and λ across 3 paraphrases.
- Enforce cite-then-explain with the traceability schema.
- If ΔS ≥ 0.60 or λ flips, return the smallest structural change to push ΔS ≤ 0.45 and raise coverage ≥ 0.70.
- Use modules BBMC, BBCR, BBPF, BBAM when relevant.

Return JSON:
{ "citations": [...], "ΔS": 0.xx, "λ_state": "<>", "coverage": 0.xx, "next_fix": "..." }

---

Common gotchas

• Mixed embedding models across write and read paths. Fix with a single family and explicit normalization. → embedding-vs-semantic.md

• HyDE prompt differs between client and server. Keep tokenization identical or move to reranking. → rerankers.md

• Formatter step renamed fields and broke citations. Add a schema check gate. → data-contracts.md

---

Escalate

• ΔS remains ≥ 0.60 after chunk and metric fixes Rebuild with the checklist and verify against a small gold set. → retrieval-playbook.md

• Live instability after deploy Investigate boot order and pre-deploy collapse. → bootstrap-ordering.md · predeploy-collapse.md

---

🔗 Quick-Start Downloads (60 sec)

Tool	Link	3-Step Setup
WFGY 1.0 PDF	Engine Paper	1️⃣ Download · 2️⃣ Upload to your LLM · 3️⃣ Ask “Answer using WFGY + <your question>”
TXT OS (plain-text OS)	TXTOS.txt	1️⃣ Download · 2️⃣ Paste into any LLM chat · 3️⃣ Type “hello world” — OS boots instantly

---

🧭 Explore More

Module	Description	Link
WFGY Core	WFGY 2.0 engine is live: full symbolic reasoning architecture and math stack	View →
Problem Map 1.0	Initial 16-mode diagnostic and symbolic fix framework	View →
Problem Map 2.0	RAG-focused failure tree, modular fixes, and pipelines	View →
Semantic Clinic Index	Expanded failure catalog: prompt injection, memory bugs, logic drift	View →
Semantic Blueprint	Layer-based symbolic reasoning & semantic modulations	View →
Benchmark vs GPT-5	Stress test GPT-5 with full WFGY reasoning suite	View →
🧙‍♂️ Starter Village 🏡	New here? Lost in symbols? Click here and let the wizard guide you through	Start →

---

👑 Early Stargazers: See the Hall of Fame — Engineers, hackers, and open source builders who supported WFGY from day one.

⭐ WFGY Engine 2.0 is already unlocked. ⭐ Star the repo to help others discover it and unlock more on the Unlock Board.