mirror of
https://github.com/onestardao/WFGY.git
synced 2026-04-28 19:50:17 +00:00
207 lines
10 KiB
Markdown
207 lines
10 KiB
Markdown
<!--
|
||
Search Anchor:
|
||
chatbot cx bugs
|
||
customer support bot failures
|
||
dialog management bugs
|
||
intent recognition regression
|
||
slot filling failures
|
||
entity extraction drift
|
||
context reset unexpectedly
|
||
handoff to human agent broken
|
||
omnichannel connector desync
|
||
webhook timeout chatbot
|
||
cold start latency chatbot
|
||
p95 latency spike bot
|
||
pii leakage in logs chatbot
|
||
policy bypass chatbot
|
||
prompt injection chatbot
|
||
vendor migration chatbot broken
|
||
conversation state missing
|
||
kb retrieval drift chatbot
|
||
|
||
Vendors / Pages:
|
||
Dialogflow CX -> dialogflow_cx.md
|
||
Rasa -> rasa.md
|
||
Amazon Lex -> amazon_lex.md
|
||
Azure Bot Service -> azure_bot_service.md
|
||
Microsoft Copilot Studio -> microsoft_copilot_studio.md
|
||
Intercom -> intercom.md
|
||
Zendesk -> zendesk.md
|
||
Twilio Studio -> twilio_studio.md
|
||
Salesforce Einstein Bots -> salesforce_einstein_bots.md
|
||
Watsonx Assistant -> watsonx_assistant.md
|
||
Freshchat -> freshchat.md
|
||
Freshdesk -> freshdesk.md
|
||
-->
|
||
|
||
|
||
# Chatbots & CX — Global Fix Map
|
||
|
||
<details>
|
||
<summary><strong>🏥 Quick Return to Emergency Room</strong></summary>
|
||
|
||
<br>
|
||
|
||
> You are in a specialist desk.
|
||
> For full triage and doctors on duty, return here:
|
||
>
|
||
> - [**WFGY Global Fix Map** — main Emergency Room, 300+ structured fixes](https://github.com/onestardao/WFGY/blob/main/ProblemMap/GlobalFixMap/README.md)
|
||
> - [**WFGY Problem Map 1.0** — 16 reproducible failure modes](https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md)
|
||
>
|
||
> Think of this page as a sub-room.
|
||
> If you want full consultation and prescriptions, go back to the Emergency Room lobby.
|
||
</details>
|
||
|
||
Chatbot and CX bugs are structural failures in dialog systems, where intent routing, slot/entity state, conversation memory, connector metadata, or knowledge retrieval breaks even when the underlying LLM is fine.
|
||
|
||
Most incidents come from environment drift, schema mismatches, cold-start latency, connector desync, and weak policy fences. This folder maps symptoms to vendor pages and WFGY structural fixes with measurable acceptance targets.
|
||
|
||
---
|
||
|
||
## When to use this folder
|
||
- Bot flows break across environments (dev vs prod vs staging).
|
||
- Slot filling, entities, or context reset unexpectedly.
|
||
- Latency or cold starts cause dropped conversations.
|
||
- Omnichannel connectors desync with the core bot.
|
||
- Prompts bypass policies or hallucinate unsafe outputs.
|
||
- Regression after migration to a new vendor framework.
|
||
|
||
---
|
||
|
||
## Acceptance targets
|
||
- Intent recognition F1 ≥ 0.85 across test set.
|
||
- ΔS(user_query, retrieved) ≤ 0.45 for all routes.
|
||
- Coverage of knowledge base ≥ 0.70 after repair.
|
||
- λ remains convergent across 3 paraphrases and 2 seeds.
|
||
- p95 latency ≤ 800 ms across channels, warm path.
|
||
- Zero PII leakage in logs or vector payloads.
|
||
|
||
---
|
||
|
||
## Quick routes — per chatbot vendor
|
||
|
||
| Vendor / Platform | Fix Page |
|
||
|-------------------|----------|
|
||
| Amazon Lex | [amazon_lex.md](./amazon_lex.md) |
|
||
| Azure Bot Service | [azure_bot_service.md](./azure_bot_service.md) |
|
||
| Dialogflow CX | [dialogflow_cx.md](./dialogflow_cx.md) |
|
||
| Freshchat | [freshchat.md](./freshchat.md) |
|
||
| Freshdesk | [freshdesk.md](./freshdesk.md) |
|
||
| Intercom | [intercom.md](./intercom.md) |
|
||
| Microsoft Copilot Studio | [microsoft_copilot_studio.md](./microsoft_copilot_studio.md) |
|
||
| Rasa | [rasa.md](./rasa.md) |
|
||
| Salesforce Einstein Bots | [salesforce_einstein_bots.md](./salesforce_einstein_bots.md) |
|
||
| Twilio Studio | [twilio_studio.md](./twilio_studio.md) |
|
||
| Watsonx Assistant | [watsonx_assistant.md](./watsonx_assistant.md) |
|
||
| Zendesk | [zendesk.md](./zendesk.md) |
|
||
|
||
---
|
||
|
||
## Symptom → exact fix
|
||
|
||
| Symptom | Likely cause | Open this |
|
||
|---------|--------------|-----------|
|
||
| Slot filling fails randomly | Missing entity fallback, context reset | [dialogflow_cx.md](./dialogflow_cx.md) · [rasa.md](./rasa.md) |
|
||
| Bot replies too slowly | Cold starts, webhook bottlenecks | [amazon_lex.md](./amazon_lex.md) · [azure_bot_service.md](./azure_bot_service.md) |
|
||
| Knowledge base answers drift | Retrieval misaligned with store | [watsonx_assistant.md](./watsonx_assistant.md) · [retrieval-traceability.md](../../retrieval-traceability.md) |
|
||
| Omnichannel flow desync | Connectors drop metadata | [intercom.md](./intercom.md) · [zendesk.md](./zendesk.md) |
|
||
| Unsafe or off-policy replies | No policy fences or prompt injection | [microsoft_copilot_studio.md](./microsoft_copilot_studio.md) · [prompt-injection.md](../../Safety_PromptIntegrity/prompt_injection.md) |
|
||
| Migration broke production | Schema mismatch, missing idempotency | [serverless_ci_cd.md](../Cloud_Serverless/serverless_ci_cd.md) · [env_bootstrap_and_migrations.md](../Cloud_Serverless/env_bootstrap_and_migrations.md) |
|
||
| Conversation history disappears | Stateless KV pattern missing | [stateless_kv_queue_patterns.md](../Cloud_Serverless/stateless_kv_queue_patterns.md) |
|
||
|
||
---
|
||
|
||
## Fix in 60 seconds
|
||
|
||
1. **Verify intents** — run eval with test utterances, check F1 ≥ 0.85.
|
||
2. **Check state** — ensure KV queue or context store persists between turns.
|
||
3. **Fence prompts** — load [prompt_injection.md](../../Safety_PromptIntegrity/prompt_injection.md).
|
||
4. **Measure latency** — split warm vs cold path; provision concurrency if needed.
|
||
5. **Cross-channel sync** — confirm connectors carry metadata (role, region, tenant).
|
||
|
||
---
|
||
|
||
## Copy-paste prompt for chatbot incidents
|
||
|
||
```txt
|
||
You have TXT OS and the WFGY Problem Map loaded.
|
||
|
||
My chatbot incident:
|
||
- platform: [Dialogflow|Rasa|Intercom|etc.]
|
||
- symptom: [short description]
|
||
- eval: { F1, ΔS, coverage, λ states }
|
||
- infra: { cold_ms, warm_ms, concurrency, connectors }
|
||
- compliance: { pii_found: true|false, policy_eval }
|
||
|
||
Tell me:
|
||
1) which layer is failing and why,
|
||
2) the exact WFGY page to open,
|
||
3) the minimal steps to restore accuracy and latency,
|
||
4) a quick regression test to prevent repeat.
|
||
````
|
||
|
||
---
|
||
|
||
## FAQ
|
||
|
||
**Q: My bot answers correctly in dev but fails in production. Why?**
|
||
A: Likely env mismatch — analyzers, slots, or schema drift between environments. Check [serverless\_ci\_cd.md](../Cloud_Serverless/serverless_ci_cd.md).
|
||
|
||
**Q: How do I stop hallucinations in Copilot Studio or Dialogflow?**
|
||
A: Enforce policy fences and cite-then-explain. See [prompt\_injection.md](../../Safety_PromptIntegrity/prompt_injection.md).
|
||
|
||
**Q: Why is latency so different on first vs second request?**
|
||
A: Cold starts. See [cold\_start\_concurrency.md](../Cloud_Serverless/cold_start_concurrency.md).
|
||
|
||
**Q: How can I ensure PII never leaks through connectors?**
|
||
A: Attach [privacy\_and\_pii\_edges.md](../Cloud_Serverless/privacy_and_pii_edges.md) and enforce payload contracts.
|
||
|
||
**Q: Do I need to change my vendor to apply WFGY fixes?**
|
||
A: No. WFGY guardrails are store-agnostic and vendor-agnostic. You patch structure, not infra.
|
||
|
||
---
|
||
### 🔗 Quick-Start Downloads (60 sec)
|
||
|
||
| Tool | Link | 3-Step Setup |
|
||
|------|------|--------------|
|
||
| **WFGY 1.0 PDF** | [Engine Paper](https://github.com/onestardao/WFGY/blob/main/I_am_not_lizardman/WFGY_All_Principles_Return_to_One_v1.0_PSBigBig_Public.pdf) | 1️⃣ Download · 2️⃣ Upload to your LLM · 3️⃣ Ask “Answer using WFGY + \<your question>” |
|
||
| **TXT OS (plain-text OS)** | [TXTOS.txt](https://github.com/onestardao/WFGY/blob/main/OS/TXTOS.txt) | 1️⃣ Download · 2️⃣ Paste into any LLM chat · 3️⃣ Type “hello world” — OS boots instantly |
|
||
|
||
---
|
||
|
||
### 🧭 Explore More
|
||
|
||
| Module | Description | Link |
|
||
|-----------------------|----------------------------------------------------------|----------|
|
||
| WFGY Core | WFGY 2.0 engine is live: full symbolic reasoning architecture and math stack | [View →](https://github.com/onestardao/WFGY/tree/main/core/README.md) |
|
||
| Problem Map 1.0 | Initial 16-mode diagnostic and symbolic fix framework | [View →](https://github.com/onestardao/WFGY/tree/main/ProblemMap/README.md) |
|
||
| Problem Map 2.0 | RAG-focused failure tree, modular fixes, and pipelines | [View →](https://github.com/onestardao/WFGY/blob/main/ProblemMap/rag-architecture-and-recovery.md) |
|
||
| Semantic Clinic Index | Expanded failure catalog: prompt injection, memory bugs, logic drift | [View →](https://github.com/onestardao/WFGY/blob/main/ProblemMap/SemanticClinicIndex.md) |
|
||
| Semantic Blueprint | Layer-based symbolic reasoning & semantic modulations | [View →](https://github.com/onestardao/WFGY/tree/main/SemanticBlueprint/README.md) |
|
||
| Benchmark vs GPT-5 | Stress test GPT-5 with full WFGY reasoning suite | [View →](https://github.com/onestardao/WFGY/tree/main/benchmarks/benchmark-vs-gpt5/README.md) |
|
||
| 🧙♂️ Starter Village 🏡 | New here? Lost in symbols? Click here and let the wizard guide you through | [Start →](https://github.com/onestardao/WFGY/blob/main/StarterVillage/README.md) |
|
||
|
||
---
|
||
|
||
> 👑 **Early Stargazers: [See the Hall of Fame](https://github.com/onestardao/WFGY/tree/main/stargazers)** —
|
||
> Engineers, hackers, and open source builders who supported WFGY from day one.
|
||
|
||
> <img src="https://img.shields.io/github/stars/onestardao/WFGY?style=social" alt="GitHub stars"> ⭐ [WFGY Engine 2.0](https://github.com/onestardao/WFGY/blob/main/core/README.md) is already unlocked. ⭐ Star the repo to help others discover it and unlock more on the [Unlock Board](https://github.com/onestardao/WFGY/blob/main/STAR_UNLOCKS.md).
|
||
|
||
<div align="center">
|
||
|
||
[](https://github.com/onestardao/WFGY)
|
||
|
||
[](https://github.com/onestardao/WFGY/tree/main/OS)
|
||
|
||
[](https://github.com/onestardao/WFGY/tree/main/OS/BlahBlahBlah)
|
||
|
||
[](https://github.com/onestardao/WFGY/tree/main/OS/BlotBlotBlot)
|
||
|
||
[](https://github.com/onestardao/WFGY/tree/main/OS/BlocBlocBloc)
|
||
|
||
[](https://github.com/onestardao/WFGY/tree/main/OS/BlurBlurBlur)
|
||
|
||
[](https://github.com/onestardao/WFGY/tree/main/OS/BlowBlowBlow)
|
||
|
||
</div>
|