Agus Zubiaga ce1a674eba eval: Fine-grained assertions (#29246) ... - Support programmatic examples ([example](17feb260a0/crates/eval/src/examples/file_search.rs)) - Combine data-driven example declarations into a single `.toml` file ([example](17feb260a0/crates/eval/src/examples/find_and_replace_diff_card.toml)) - Run judge on individual assertions (previously called "criteria") - Report judge and programmatic assertions in one combined table Note: We still need to work on concept naming <img width=400 src="https://github.com/user-attachments/assets/fc719c93-467f-412b-8d47-68821bd8a5f5"> Release Notes: - N/A --------- Co-authored-by: Richard Feldman <oss@rtfeldman.com> Co-authored-by: Max Brunsfeld <maxbrunsfeld@gmail.com> Co-authored-by: Thomas Mickley-Doyle <tmickleydoyle@gmail.com>		2025-04-22 23:58:58 -03:00
..
examples	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00
assertions.rs	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00
eval.rs	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00
example.rs	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00
ids.rs	Add new action to run agent eval (#29158)	2025-04-21 21:30:21 -07:00
instance.rs	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00
judge_diff_prompt.hbs	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00
judge_thread_prompt.hbs	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00
tool_metrics.rs	eval: Fine-grained assertions (#29246)	2025-04-22 23:58:58 -03:00