vrr/awesome-opencode
2
0
Fork 0
mirror of https://github.com/awesome-opencode/awesome-opencode.git synced 2026-07-09 17:19:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #405 from nano-step/add-eval-harness

Browse source 
docs: add eval-harness to projects — behavior-regression testing for OpenCode skills
This commit is contained in:
Lucas Shamanic 2026-06-27 10:56:11 +01:00 • committed by GitHub
commit c4ce695d04
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 4 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

4
data/projects/eval-harness.yaml Normal file
View file

@ -0,0 +1,4 @@
name: eval-harness
repo: https://github.com/nano-step/eval-harness
tagline: Behavior-regression testing for OpenCode skills
description: Detects when an OpenCode skill's behavior drifts from a baseline, attributes the cause across 4 classes (skill change / fixture stale / model change / unknown drift), and emits a 6-field FAIL schema with transcript-span and env-delta evidence. Ships a git pre-push hook, a composite GitHub Action, and a $-cost hard ceiling for CI safety. Bash + jq + python3 stdlib only; no daemon, no SaaS. MIT.