5.4 KiB
OCR + Parsing — Global Fix Map
Triage and repair for scanned PDFs, images, HTML scraping, and parser noise.
Use this page when the documents look fine to the eye but retrieval or reasoning keeps drifting.
Quick routes to per-problem pages
-
Layout, headers, and footers
→ layout_headers_and_footers.md -
Tokenization and casing
→ tokenization_and_casing.md -
Tables and columns
→ tables_and_columns.md -
Images and figures
→ images_and_figures.md -
Scanned PDFs and quality
→ scanned_pdfs_and_quality.md -
Multi-language and fonts
→ multi_language_and_fonts.md
When to use
- OCR tables or citations look visually correct but answers miss the right section.
- Code blocks or math collapse after parsing.
- Mixed language documents behave inconsistently.
- Special characters or hyphen splits break tokens.
- Headers or section anchors disappear during export.
Acceptance targets
- ΔS(question, retrieved) ≤ 0.45 for three paraphrases.
- Coverage ≥ 0.70 for the target section.
- λ remains convergent across two seeds.
- Human audit shows no missing headers or broken tables in the exported bundle.
Fix in 60 seconds
-
Ground-truth a page
Pick one question and one expected section. Keep a screenshot for reference. -
Measure ΔS
Compute ΔS(question, retrieved) and ΔS(retrieved, anchor).
Stable < 0.40, transitional 0.40–0.60, risk ≥ 0.60. -
Probe λ_observe
Ask for cite-first answers. If citations fail but free-form explain passes, drift is confirmed. -
Patch minimally
- Re-run OCR with line preservation and table fences.
- Normalize casing and Unicode forms.
- Keep section anchors, captions, and math fenced.
- Drop low-confidence spans, mark gaps, and export text with
section_id,page_no,char_span.
🔗 Quick-Start Downloads (60 sec)
| Tool | Link | 3-Step Setup |
|---|---|---|
| WFGY 1.0 PDF | Engine Paper | 1️⃣ Download · 2️⃣ Upload · 3️⃣ Ask “Answer using WFGY + <your question>” |
| TXT OS | TXTOS.txt | 1️⃣ Download · 2️⃣ Paste into LLM · 3️⃣ Type “hello world” — OS boots instantly |
🧭 Explore More
| Module | Description | Link |
|---|---|---|
| WFGY Core | WFGY 2.0 engine, full symbolic reasoning | View → |
| Problem Map 1.0 | Initial 16-mode diagnostic | View → |
| Problem Map 2.0 | RAG failure tree and modular fixes | View → |
| Semantic Clinic | Expanded failure catalog | View → |
| Semantic Blueprint | Layer-based symbolic reasoning | View → |
👑 Early Stargazers: See the Hall of Fame —
Engineers, hackers, and open source builders who supported WFGY from day one.
⭐ WFGY Engine 2.0 is already unlocked. ⭐ Star the repo to help others discover it and unlock more on the Unlock Board.
