diff --git a/ProblemMap/GlobalFixMap/Automation/retool.md b/ProblemMap/GlobalFixMap/Automation/retool.md new file mode 100644 index 00000000..52bd1ec0 --- /dev/null +++ b/ProblemMap/GlobalFixMap/Automation/retool.md @@ -0,0 +1,187 @@ +# Retool — Guardrails and Fix Patterns + +Use this when your stack uses **Retool** (Queries, Transformers, Workflows, Resources) and you see wrong snippets, unstable reasoning, mixed sources, or silent failures that look fine in logs. + +**Acceptance targets** +- ΔS(question, retrieved) ≤ 0.45 +- Coverage ≥ 0.70 to the intended section or record +- λ stays convergent across 3 paraphrases + +--- + +## Typical breakpoints → exact fixes + +- Query returns plausible but wrong rows or snippets + Fix No.1: Hallucination and Chunk Drift → + [Hallucination](https://github.com/onestardao/WFGY/blob/main/ProblemMap/hallucination.md) + Also review the Retrieval Playbook → + [Retrieval Playbook](https://github.com/onestardao/WFGY/blob/main/ProblemMap/retrieval-playbook.md) + +- High cosine similarity but meaning is wrong + Fix No.5: Embedding ≠ Semantic → + [Embedding ≠ Semantic](https://github.com/onestardao/WFGY/blob/main/ProblemMap/embedding-vs-semantic.md) + +- Some facts exist but never surface in search widgets or tables + Pattern: Vectorstore Fragmentation → + [Vectorstore Fragmentation](https://github.com/onestardao/WFGY/blob/main/ProblemMap/patterns/pattern_vectorstore_fragmentation.md) + +- Citations missing or inconsistent between retriever result and LLM response + Fix No.8: Retrieval Traceability with Data Contracts → + [Retrieval Traceability](https://github.com/onestardao/WFGY/blob/main/ProblemMap/retrieval-traceability.md) · + [Data Contracts](https://github.com/onestardao/WFGY/blob/main/ProblemMap/data-contracts.md) + +- Long chains flatten tone or drift logically in Workflows + Fix No.3 and No.9: Context Drift and Entropy Collapse → + [Context Drift](https://github.com/onestardao/WFGY/blob/main/ProblemMap/context-drift.md) · + [Entropy Collapse](https://github.com/onestardao/WFGY/blob/main/ProblemMap/entropy-collapse.md) + +- App works in Preview but breaks after deploy or after environment switch + Fix No.16 and Infra family → + [Pre-Deploy Collapse](https://github.com/onestardao/WFGY/blob/main/ProblemMap/predeploy-collapse.md) · + [Bootstrap Ordering](https://github.com/onestardao/WFGY/blob/main/ProblemMap/bootstrap-ordering.md) · + [Deployment Deadlock](https://github.com/onestardao/WFGY/blob/main/ProblemMap/deployment-deadlock.md) + +- Confident tone but incorrect answers in AI components + Fix No.4: Bluffing and Overconfidence → + [Bluffing](https://github.com/onestardao/WFGY/blob/main/ProblemMap/bluffing.md) + +--- + +## Minimal Retool pattern with WFGY checks + +```js +// Retool App example: one LLM answer path with observable retrieval and WFGY checks + +// 1) Retrieval query (REST or SQL). Keep params explicit and logged. +const k = 10; +const question = textInput_question.value; + +// Example fetch to your retriever API +const retrieved = await retrieverApi.trigger({ + additionalScope: { question, k } // ensure same tokenizer and metric across write/read +}); + +// 2) Assemble schema-locked prompt. Cite first, then explain. +const context = joinSnippets(retrieved.data); +const prompt = ` +SYSTEM: +You must cite lines before any explanation. +TASK: +Answer the user's question using the provided context. +CONSTRAINTS: +- Do not mix sources +- Provide snippet_id for each citation +CONTEXT: +${context} +QUESTION: +${question} +`; + +// 3) Call model +const answer = await llmApi.trigger({ additionalScope: { prompt }}); + +// 4) WFGY post-checks. Compute ΔS(question, context) and record trace table. +const metrics = await wfgyCheckApi.trigger({ + additionalScope: { question, context, answer: answer.data } +}); + +// 5) Fail fast when ΔS ≥ 0.60 or λ is divergent +if (metrics.data.deltaS >= 0.60 || metrics.data.lambda !== "→") { + utils.showNotification("High semantic stress. See trace tab.", "warning"); + return { status: "needs_fix", ...metrics.data }; +} + +return { status: "ok", answer: answer.data, ...metrics.data }; +```` + +**What this enforces** + +* Retrieval is parameterized and observable in Retool Query logs. +* Prompt is schema locked with citation first. +* WFGY check runs after generation and can stop the run when ΔS is high or λ flips. +* Traces are kept as a snippet to citation table for audit. + +Reference specs +[RAG Architecture and Recovery](https://github.com/onestardao/WFGY/blob/main/ProblemMap/rag-architecture-and-recovery.md) · +[Retrieval Playbook](https://github.com/onestardao/WFGY/blob/main/ProblemMap/retrieval-playbook.md) · +[Retrieval Traceability](https://github.com/onestardao/WFGY/blob/main/ProblemMap/retrieval-traceability.md) · +[Data Contracts](https://github.com/onestardao/WFGY/blob/main/ProblemMap/data-contracts.md) + +--- + +## Retool specific gotchas + +* Resource points to a different environment or secret than the indexer used. Pin versions and verify headers. + See [Pre-Deploy Collapse](https://github.com/onestardao/WFGY/blob/main/ProblemMap/predeploy-collapse.md) + +* Mixed metrics or normalization between ingestion code and query code in Workflows. Rebuild with explicit metric and unit normalization. + See [Embedding ≠ Semantic](https://github.com/onestardao/WFGY/blob/main/ProblemMap/embedding-vs-semantic.md) + +* Transformers silently reshape or re-rank without trace. Require cite first and include `snippet_id` headers. + See [Retrieval Traceability](https://github.com/onestardao/WFGY/blob/main/ProblemMap/retrieval-traceability.md) and + [Data Contracts](https://github.com/onestardao/WFGY/blob/main/ProblemMap/data-contracts.md) + +* Parallel queries cause ordering instability. Add a rerank step only after per-source ΔS ≤ 0.50. + See [Rerankers](https://github.com/onestardao/WFGY/blob/main/ProblemMap/rerankers.md) + +* Workflow scheduled runs build a fresh index incorrectly. Enforce idempotent builds with boot checks. + See [Bootstrap Ordering](https://github.com/onestardao/WFGY/blob/main/ProblemMap/bootstrap-ordering.md) + +--- + +## When to escalate + +* ΔS stays ≥ 0.60 after chunk and retrieval fixes + Work through the playbook and rebuild index parameters. + [Retrieval Playbook](https://github.com/onestardao/WFGY/blob/main/ProblemMap/retrieval-playbook.md) + +* Answers flip between environments or sessions + Verify version skew and session state. + [Pre-Deploy Collapse](https://github.com/onestardao/WFGY/blob/main/ProblemMap/predeploy-collapse.md) + + +--- + +### 🔗 Quick-Start Downloads (60 sec) + +| Tool | Link | 3-Step Setup | +|------|------|--------------| +| **WFGY 1.0 PDF** | [Engine Paper](https://github.com/onestardao/WFGY/blob/main/I_am_not_lizardman/WFGY_All_Principles_Return_to_One_v1.0_PSBigBig_Public.pdf) | 1️⃣ Download · 2️⃣ Upload to your LLM · 3️⃣ Ask “Answer using WFGY + \” | +| **TXT OS (plain-text OS)** | [TXTOS.txt](https://github.com/onestardao/WFGY/blob/main/OS/TXTOS.txt) | 1️⃣ Download · 2️⃣ Paste into any LLM chat · 3️⃣ Type “hello world” — OS boots instantly | + +--- + +### 🧭 Explore More + +| Module | Description | Link | +|-----------------------|----------------------------------------------------------|----------| +| WFGY Core | WFGY 2.0 engine is live: full symbolic reasoning architecture and math stack | [View →](https://github.com/onestardao/WFGY/tree/main/core/README.md) | +| Problem Map 1.0 | Initial 16-mode diagnostic and symbolic fix framework | [View →](https://github.com/onestardao/WFGY/tree/main/ProblemMap/README.md) | +| Problem Map 2.0 | RAG-focused failure tree, modular fixes, and pipelines | [View →](https://github.com/onestardao/WFGY/blob/main/ProblemMap/rag-architecture-and-recovery.md) | +| Semantic Clinic Index | Expanded failure catalog: prompt injection, memory bugs, logic drift | [View →](https://github.com/onestardao/WFGY/blob/main/ProblemMap/SemanticClinicIndex.md) | +| Semantic Blueprint | Layer-based symbolic reasoning & semantic modulations | [View →](https://github.com/onestardao/WFGY/tree/main/SemanticBlueprint/README.md) | +| Benchmark vs GPT-5 | Stress test GPT-5 with full WFGY reasoning suite | [View →](https://github.com/onestardao/WFGY/tree/main/benchmarks/benchmark-vs-gpt5/README.md) | +| 🧙‍♂️ Starter Village 🏡 | New here? Lost in symbols? Click here and let the wizard guide you through | [Start →](https://github.com/onestardao/WFGY/blob/main/StarterVillage/README.md) | + +--- + +> 👑 **Early Stargazers: [See the Hall of Fame](https://github.com/onestardao/WFGY/tree/main/stargazers)** — +> GitHub stars ⭐ [WFGY Engine 2.0](https://github.com/onestardao/WFGY/blob/main/core/README.md) is already unlocked. ⭐ Star the repo to help others discover it and unlock more on the Unlock Board. + +
+ +[![WFGY Main](https://img.shields.io/badge/WFGY-Main-red?style=flat-square)](https://github.com/onestardao/WFGY) +  +[![TXT OS](https://img.shields.io/badge/TXT%20OS-Reasoning%20OS-orange?style=flat-square)](https://github.com/onestardao/WFGY/tree/main/OS) +  +[![Blah](https://img.shields.io/badge/Blah-Semantic%20Embed-yellow?style=flat-square)](https://github.com/onestardao/WFGY/tree/main/OS/BlahBlahBlah) +  +[![Blot](https://img.shields.io/badge/Blot-Persona%20Core-green?style=flat-square)](https://github.com/onestardao/WFGY/tree/main/OS/BlotBlotBlot) +  +[![Bloc](https://img.shields.io/badge/Bloc-Reasoning%20Compiler-blue?style=flat-square)](https://github.com/onestardao/WFGY/tree/main/OS/BlocBlocBloc) +  +[![Blur](https://img.shields.io/badge/Blur-Text2Image%20Engine-navy?style=flat-square)](https://github.com/onestardao/WFGY/tree/main/OS/BlurBlurBlur) +  +[![Blow](https://img.shields.io/badge/Blow-Game%20Logic-purple?style=flat-square)](https://github.com/onestardao/WFGY/tree/main/OS/BlowBlowBlow) +  +