vrr/llm-checker
2
0
Fork 0
mirror of https://github.com/signerless/llm-checker.git synced 2026-10-21 05:22:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
llm-checker/docs
History
signerless 2bfd8fdc4c feat(quality): ship benchmark scores in the snapshot and add model-card results 
- `sync:seed` runs scripts/update-quality-seed.js, which refreshes every
  quality source inside the snapshot (a failed source keeps its previous
  scores). A fresh install had no benchmark data and ranked every model by
  parameter count until the user ran `quality-sync`.
- Existing databases import a snapshot's quality source when it is newer
  than their own copy, and rebuild the catalog cohort.
- New `hf_eval_results` source: GPQA, MMLU-Pro, HLE, SWE-bench,
  Terminal-Bench, GSM8K, AIME/HMMT, IFEval and MMMU results attached to Hub
  repos. Self-reported, marked not independent, last in each category's
  metric preference.
- LiveBench discovers releases from the site bundle and adds those newer
  than the curated list; older question sets stay out.
2026-10-04 15:38:10 +00:00
..
fixtures/calibration feat(calibration): add routing policy flow and docs hub 2026-02-17 18:49:45 +01:00
guides docs: document the multi-source model registry (3.7.0) 2026-06-20 11:24:47 +02:00
reference feat(quality): ship benchmark scores in the snapshot and add model-card results 2026-10-04 15:38:10 +00:00
ranking-contract-validation.md fix: remove fabricated precision and size fallbacks from Ollama metadata 2026-09-06 15:40:12 +02:00
README.md docs(roadmap): add ollama critical needs plan 2026-02-17 19:13:25 +01:00

README.md

LLM Checker Docs

Central documentation index for this project.

Guides

Reference

Fixtures