vrr/llm-checker
2
0
Fork 0
mirror of https://github.com/signerless/llm-checker.git synced 2026-10-19 01:49:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llm-checker/tests
History
Exact
signerless 67fa1fb7f8 test: give the CPU-only CLI runs a 120 s budget 
Each case spawns the real CLI with live hardware detection. Alone a run
takes about 20 s, but inside the full suite on a loaded laptop it went
past the 45 s limit, which failed npm test and therefore npm publish.
2026-10-13 13:04:30 +02:00
..
calibration-fixtures feat(calibration): add routing policy flow and docs hub 2026-02-17 18:49:45 +01:00
fixtures/quality feat(quality): ingest official HF and LMArena benchmark snapshots 2026-09-06 13:02:53 +02:00
policy-fixtures feat(policy): complete enterprise gate/reporting coverage 2026-02-17 11:13:48 +01:00
ai-check-hardware-detection.test.js fix(ai-check): use canonical GPU detection 2026-08-28 15:35:48 +02:00
amd-gpu-detection.test.js feat(hardware): improve GPU detection and model optimization profiles 2026-02-17 13:50:04 +01:00
banner-canonical.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
calibrate-command.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
calibration-e2e-integration.test.js fix(ranking): rank base checkpoints below instruct builds and dedupe aliases 2026-10-04 15:32:33 +00:00
calibration-full-mode.test.js feat(calibrate): add full calibration execution and policy synthesis 2026-02-17 17:17:58 +01:00
calibration-routing-policy.test.js feat(calibration): add routing policy flow and docs hub 2026-02-17 18:49:45 +01:00
calibration-schema.test.js feat(calibrate): add full calibration execution and policy synthesis 2026-02-17 17:17:58 +01:00
catalog-variant-metadata.test.js perf(quality): index benchmark rows by checkpoint label 2026-10-04 16:43:30 +00:00
cli-interactive-panel.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
cpu-detector-windows-fallback.test.js fix(tests): make hardware/perf/cpu/ollama tests hermetic and deterministic 2026-06-10 20:28:33 +02:00
cpu-only-mode.test.js test: give the CPU-only CLI runs a 120 s budget 2026-10-13 13:04:30 +02:00
cuda-jetson-detection.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
database-backends.test.js feat(quality): ingest official HF and LMArena benchmark snapshots 2026-09-06 13:02:53 +02:00
default-model-safety.test.js test: verify concurrent hardware child processes and probe deadlines 2026-09-06 12:42:32 +02:00
desktop-core.test.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
deterministic-model-pool-check.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
fine-tuning-support.test.js fix: resolve issues #58 #59 and add fine-tuning output (#60) 2026-03-05 10:23:37 +01:00
hardware-detector-regression.js fix(hardware): correct VRAM unit handling and dedupe multi-source GPU inventory 2026-06-10 20:41:22 +02:00
hardware-integrated-memory-units.test.js test: pin Linux platform in the integrated-memory and Strix Halo fixtures 2026-10-13 12:50:53 +02:00
hardware-parallel-probes.test.js test: make parallel probe fixture independent of host GPUs 2026-09-06 12:45:58 +02:00
hardware-simulation-tests.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
hardware-tier-consistency.test.js fix: unify hardware tier reporting across commands (#74) 2026-03-28 12:11:24 +00:00
hardware-vram-highend.test.js fix(hardware): correct GPU-VRAM detection for high-end / multi-GPU machines 2026-06-19 21:01:16 +02:00
local-features-e2e.test.js chore: commit all local changes 2026-02-18 13:57:40 +01:00
mcp-multiclient.test.mjs feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
mcp-server.test.mjs feat: add explicit CPU-only execution mode 2026-08-28 17:03:47 +02:00
model-registry-ingestors.test.js Add multi-source model registry 2026-06-20 10:22:19 +02:00
model-registry-main-flow.test.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
model-registry-param-parsing.test.js fix: exclude non-language repositories from model recommendations 2026-09-06 12:33:24 +02:00
model-registry-recommender.test.js fix: report actual evaluation counts for each category 2026-09-06 12:34:33 +02:00
model-registry-seed.test.js feat(quality): ingest official HF and LMArena benchmark snapshots 2026-09-06 13:02:53 +02:00
modelvet-verify.test.js feat: modelvet structural validation (WASM) for GGUF/safetensors 2026-08-04 15:12:32 +02:00
multi-objective-selector-regression.test.js Fix ROCm memory parsing and RTX 5060 recommendations (#82) 2026-05-03 13:03:10 +02:00
ollama-capacity-planner.test.js feat(cli): add ollama runtime capacity planner command 2026-02-17 19:34:49 +01:00
ollama-client-ipv6-fallback.test.js fix(ollama): add working IPv6 loopback fallback 2026-03-26 14:11:32 +01:00
ollama-client-localhost-fallback.test.js fix(windows): improve ollama loopback and gpu assist detection (#70) 2026-03-25 23:00:23 +01:00
ollama-client-native-fetch-fallback.test.js fix(ollama): retry native fetch failures with node-fetch 2026-03-27 15:54:05 +01:00
ollama-client-speed-metrics.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
ollama-client-wildcard-host-normalization.test.js fix(ollama): normalize wildcard OLLAMA_HOST values 2026-03-27 20:54:45 +01:00
ollama-scraper-parsing.test.js fix(ollama): classify more model licenses and skip acceptable-use policies 2026-10-04 16:09:50 +00:00
ollama-selector-ipv6-fallback.test.js fix(ollama): add working IPv6 loopback fallback 2026-03-26 14:11:32 +01:00
ollama-selector-localhost-fallback.test.js fix(ollama): reuse resolved loopback client in selectors 2026-03-26 10:16:12 +01:00
packaged-snapshot-refresh.test.js feat(quality): ship benchmark scores in the snapshot and add model-card results 2026-10-04 15:38:10 +00:00
policy-audit-reporter.test.js fix(ci): include policy audit reporter test in repo 2026-02-17 12:18:53 +01:00
policy-cli-enforcement.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
policy-commands.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
policy-e2e-integration.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
policy-engine.test.js feat(policy): complete enterprise gate/reporting coverage 2026-02-17 11:13:48 +01:00
policy-structural-validation.test.js feat: modelvet structural validation (WASM) for GGUF/safetensors 2026-08-04 15:12:32 +02:00
quality-evals.test.js feat(quality): ship benchmark scores in the snapshot and add model-card results 2026-10-04 15:38:10 +00:00
ranking-contract.test.js fix: remove fabricated precision and size fallbacks from Ollama metadata 2026-09-06 15:40:12 +02:00
registry-cli-validation.test.js feat(cli): let search/list-models query the multi-source registry 2026-06-20 15:34:59 +02:00
registry-diversity.test.js fix(ranking): rank base checkpoints below instruct builds and dedupe aliases 2026-10-04 15:32:33 +00:00
registry-docker.test.js feat(registry): add Docker Model Runner as a source and runtime 2026-10-04 15:52:04 +00:00
registry-hf-metadata.test.js fix(registry): reject artifacts whose size contradicts their parameters 2026-10-04 14:14:13 +00:00
registry-ingestor-quality.test.js fix: exclude non-language repositories from model recommendations 2026-09-06 12:33:24 +02:00
registry-modelscope.test.js feat(registry): add ModelScope as a registry source 2026-10-04 16:08:33 +00:00
roadmap-tools.test.js fix(gpu-plan): deduplicate generic GPU fallback 2026-08-28 15:45:39 +02:00
rocm-vram-parsing.test.js fix: interpret integrated GPU apertures in MB and cap shared memory 2026-09-06 12:45:30 +02:00
run-all-tests.js feat(registry): add ModelScope as a registry source 2026-10-04 16:08:33 +00:00
runtime-specdec-tests.js fix(runtime): honor llama.cpp and Transformers command selection 2026-09-06 12:54:51 +02:00
scoring-unification.test.js fix(#88): unify check/recommend/smart-recommend on one scoring core 2026-06-19 21:08:56 +02:00
selector-memory-sizing.test.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
speed-benchmark-sync-restore.test.js fix: retain speed telemetry through failed and incomplete catalog syncs 2026-09-06 12:37:35 +02:00
strix-halo-unified-memory.test.js test: pin Linux platform in the integrated-memory and Strix Halo fixtures 2026-10-13 12:50:53 +02:00
termux-platform-support.test.js fix: add termux platform support 2026-03-07 12:19:00 +01:00
token-speed-estimation.test.js fix(tests): make hardware/perf/cpu/ollama tests hermetic and deterministic 2026-06-10 20:28:33 +02:00
ui-cli-smoke.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
verify-gates.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
virtual-monitor-gpu-detection.test.js fix(hardware): ignore virtual display adapters in GPU detection (#106) 2026-06-22 21:23:42 +02:00
windows-panel-overflow.test.js fix(ui): stop interactive-panel flicker on Windows resize and 46-49 row band (#86) 2026-06-19 21:00:20 +02:00