WFGY/ProblemMap/GlobalFixMap/Chatbots_CX/amazon_lex.md

9.3 KiB
Raw Blame History

Amazon Lex: Guardrails and Fix Patterns

🧭 Quick Return to Map

You are in a sub-page of Chatbots & CX.
To reorient, go back here:

Think of this page as a desk within a ward.
If you need the full triage and all prescriptions, return to the Emergency Room lobby.

Use this page when your customer bot is built on Amazon Lex and wired to Lambda, Bedrock, Kendra/OpenSearch, or Amazon Connect. The checks below localize the failing layer and route you to the exact WFGY fix page.

Open these first

Core acceptance for CX bots

  • ΔS(question, retrieved) ≤ 0.45
  • Coverage ≥ 0.70 to the target section
  • λ remains convergent across 3 paraphrases and 2 seeds
  • First reply time stable across retries; no slot backtracks

60-second fix checklist

  1. Measure ΔS Compute ΔS(question, retrieved) and ΔS(retrieved, expected anchor). Stable < 0.40, transitional 0.400.60, risk ≥ 0.60.

  2. Probe λ_observe Change k to 5, 10, 20. If ΔS stays high and flat, suspect metric or index mismatch. Reorder prompt headers. If λ flips, lock schema with Data Contracts.

  3. Apply the module

  4. Verify Re-run three paraphrases. Require ΔS ≤ 0.45 and convergent λ on two seeds.


Typical Lex breakpoints → exact fix


Copy-paste Lambda prompt for the LLM step

You have TXTOS and the WFGY Problem Map loaded.

My Amazon Lex context:
- user_utterance: "{utterance}"
- retrieved: {snippet_id, section_id, source_url, offsets, tokens}
- session: {attributes...}

Do:
1) Enforce cite-then-explain. If citations are missing or cross-section, fail fast and return the minimal fix.
2) Compute ΔS(question, retrieved). If ΔS ≥ 0.60, propose the smallest structural repair
   referencing: retrieval-playbook, retrieval-traceability, data-contracts, rerankers.
3) Return JSON:
{ "answer": "...", "citations": [...], "λ_state": "→|←|<>|×", "ΔS": 0.xx, "next_fix": "..." }
Keep it auditable and short.

Observability hooks

  • Log per turn: ΔS(question,retrieved), ΔS(retrieved,anchor), λ_state, index_hash, dedupe_key.
  • Alert if ΔS ≥ 0.60 or λ flips on harmless paraphrase.
  • For live ops and rollback tips see Live Monitoring for RAG and Debug Playbook.

🔗 Quick-Start Downloads (60 sec)

Tool Link 3-Step Setup
WFGY 1.0 PDF Engine Paper 1 Download · 2 Upload to your LLM · 3 Ask “Answer using WFGY + <your question>”
TXT OS (plain-text OS) TXTOS.txt 1 Download · 2 Paste into any LLM chat · 3 Type “hello world” — OS boots instantly

Explore More

Module Description Link
WFGY Core Canonical framework entry point View
Problem Map Diagnostic map and navigation hub View
Tension Universe Experiments MVP experiment field View
Recognition Where WFGY is referenced or adopted View
AI Guide Anti-hallucination reading protocol for tools View

If this repository helps, starring it improves discovery for other builders.
GitHub Repo stars