vrr/WFGY
2
0
Fork 0
mirror of https://github.com/onestardao/WFGY.git synced 2026-04-28 11:40:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

Update eval_semantic_stability.md

Browse source
This commit is contained in:
PSBigBig × MiniPS 2026-02-26 15:47:04 +08:00 • committed by GitHub
parent bdeab6d983
commit f8f3946e84
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 5 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

5
ProblemMap/GlobalFixMap/Eval/eval_semantic_stability.md
View file

@ -16,6 +16,11 @@
> If you need the full triage and all prescriptions, return to the Emergency Room lobby.
</details>
> **Evaluation disclaimer (semantic stability)**
> Stability scores in this page are heuristic signals about how outputs move under small changes.
> They do not prove global robustness or safety and should be combined with other checks.
---
**Goal**
Quantify how **stable** your pipeline is under small, *non-semantic* perturbations: different seeds, low temperature noise, and benign **prompt jitters** (punctuation/whitespace/synonym swaps). A robust system should keep claims, citations, refusals, and constraint echos **invariant** (or nearly so).