vrr/llm-checker
2
0
Fork 0
mirror of https://github.com/signerless/llm-checker.git synced 2026-10-19 09:54:45 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llm-checker/tests
History
signerless 012dd5a9c9 test: pin Linux platform in the integrated-memory and Strix Halo fixtures 
Both tests describe Linux hosts, but UnifiedDetector only collects the
generic GPU inventory on Linux and Windows, so on macOS systemGpu stayed
null and the suite failed. Force process.platform to linux for the
duration of each fixture and restore it afterwards.
2026-10-13 12:50:53 +02:00
..
calibration-fixtures feat(calibration): add routing policy flow and docs hub 2026-02-17 18:49:45 +01:00
fixtures/quality feat(quality): ingest official HF and LMArena benchmark snapshots 2026-09-06 13:02:53 +02:00
policy-fixtures feat(policy): complete enterprise gate/reporting coverage 2026-02-17 11:13:48 +01:00
ai-check-hardware-detection.test.js fix(ai-check): use canonical GPU detection 2026-08-28 15:35:48 +02:00
amd-gpu-detection.test.js feat(hardware): improve GPU detection and model optimization profiles 2026-02-17 13:50:04 +01:00
banner-canonical.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
calibrate-command.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
calibration-e2e-integration.test.js fix(ranking): rank base checkpoints below instruct builds and dedupe aliases 2026-10-04 15:32:33 +00:00
calibration-full-mode.test.js feat(calibrate): add full calibration execution and policy synthesis 2026-02-17 17:17:58 +01:00
calibration-routing-policy.test.js feat(calibration): add routing policy flow and docs hub 2026-02-17 18:49:45 +01:00
calibration-schema.test.js feat(calibrate): add full calibration execution and policy synthesis 2026-02-17 17:17:58 +01:00
catalog-variant-metadata.test.js perf(quality): index benchmark rows by checkpoint label 2026-10-04 16:43:30 +00:00
cli-interactive-panel.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
cpu-detector-windows-fallback.test.js fix(tests): make hardware/perf/cpu/ollama tests hermetic and deterministic 2026-06-10 20:28:33 +02:00
cpu-only-mode.test.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
cuda-jetson-detection.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
database-backends.test.js feat(quality): ingest official HF and LMArena benchmark snapshots 2026-09-06 13:02:53 +02:00
default-model-safety.test.js test: verify concurrent hardware child processes and probe deadlines 2026-09-06 12:42:32 +02:00
desktop-core.test.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
deterministic-model-pool-check.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
fine-tuning-support.test.js fix: resolve issues #58 #59 and add fine-tuning output (#60) 2026-03-05 10:23:37 +01:00
hardware-detector-regression.js fix(hardware): correct VRAM unit handling and dedupe multi-source GPU inventory 2026-06-10 20:41:22 +02:00
hardware-integrated-memory-units.test.js test: pin Linux platform in the integrated-memory and Strix Halo fixtures 2026-10-13 12:50:53 +02:00
hardware-parallel-probes.test.js test: make parallel probe fixture independent of host GPUs 2026-09-06 12:45:58 +02:00
hardware-simulation-tests.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
hardware-tier-consistency.test.js fix: unify hardware tier reporting across commands (#74) 2026-03-28 12:11:24 +00:00
hardware-vram-highend.test.js fix(hardware): correct GPU-VRAM detection for high-end / multi-GPU machines 2026-06-19 21:01:16 +02:00
local-features-e2e.test.js chore: commit all local changes 2026-02-18 13:57:40 +01:00
mcp-multiclient.test.mjs feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
mcp-server.test.mjs feat: add explicit CPU-only execution mode 2026-08-28 17:03:47 +02:00
model-registry-ingestors.test.js Add multi-source model registry 2026-06-20 10:22:19 +02:00
model-registry-main-flow.test.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
model-registry-param-parsing.test.js fix: exclude non-language repositories from model recommendations 2026-09-06 12:33:24 +02:00
model-registry-recommender.test.js fix: report actual evaluation counts for each category 2026-09-06 12:34:33 +02:00
model-registry-seed.test.js feat(quality): ingest official HF and LMArena benchmark snapshots 2026-09-06 13:02:53 +02:00
modelvet-verify.test.js feat: modelvet structural validation (WASM) for GGUF/safetensors 2026-08-04 15:12:32 +02:00
multi-objective-selector-regression.test.js Fix ROCm memory parsing and RTX 5060 recommendations (#82) 2026-05-03 13:03:10 +02:00
ollama-capacity-planner.test.js feat(cli): add ollama runtime capacity planner command 2026-02-17 19:34:49 +01:00
ollama-client-ipv6-fallback.test.js fix(ollama): add working IPv6 loopback fallback 2026-03-26 14:11:32 +01:00
ollama-client-localhost-fallback.test.js fix(windows): improve ollama loopback and gpu assist detection (#70) 2026-03-25 23:00:23 +01:00
ollama-client-native-fetch-fallback.test.js fix(ollama): retry native fetch failures with node-fetch 2026-03-27 15:54:05 +01:00
ollama-client-speed-metrics.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
ollama-client-wildcard-host-normalization.test.js fix(ollama): normalize wildcard OLLAMA_HOST values 2026-03-27 20:54:45 +01:00
ollama-scraper-parsing.test.js fix(ollama): classify more model licenses and skip acceptable-use policies 2026-10-04 16:09:50 +00:00
ollama-selector-ipv6-fallback.test.js fix(ollama): add working IPv6 loopback fallback 2026-03-26 14:11:32 +01:00
ollama-selector-localhost-fallback.test.js fix(ollama): reuse resolved loopback client in selectors 2026-03-26 10:16:12 +01:00
packaged-snapshot-refresh.test.js feat(quality): ship benchmark scores in the snapshot and add model-card results 2026-10-04 15:38:10 +00:00
policy-audit-reporter.test.js fix(ci): include policy audit reporter test in repo 2026-02-17 12:18:53 +01:00
policy-cli-enforcement.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
policy-commands.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
policy-e2e-integration.test.js test: hermeticity + accurate reporting + real large-model coverage 2026-06-10 21:10:39 +02:00
policy-engine.test.js feat(policy): complete enterprise gate/reporting coverage 2026-02-17 11:13:48 +01:00
policy-structural-validation.test.js feat: modelvet structural validation (WASM) for GGUF/safetensors 2026-08-04 15:12:32 +02:00
quality-evals.test.js feat(quality): ship benchmark scores in the snapshot and add model-card results 2026-10-04 15:38:10 +00:00
ranking-contract.test.js fix: remove fabricated precision and size fallbacks from Ollama metadata 2026-09-06 15:40:12 +02:00
registry-cli-validation.test.js feat(cli): let search/list-models query the multi-source registry 2026-06-20 15:34:59 +02:00
registry-diversity.test.js fix(ranking): rank base checkpoints below instruct builds and dedupe aliases 2026-10-04 15:32:33 +00:00
registry-docker.test.js feat(registry): add Docker Model Runner as a source and runtime 2026-10-04 15:52:04 +00:00
registry-hf-metadata.test.js fix(registry): reject artifacts whose size contradicts their parameters 2026-10-04 14:14:13 +00:00
registry-ingestor-quality.test.js fix: exclude non-language repositories from model recommendations 2026-09-06 12:33:24 +02:00
registry-modelscope.test.js feat(registry): add ModelScope as a registry source 2026-10-04 16:08:33 +00:00
roadmap-tools.test.js fix(gpu-plan): deduplicate generic GPU fallback 2026-08-28 15:45:39 +02:00
rocm-vram-parsing.test.js fix: interpret integrated GPU apertures in MB and cap shared memory 2026-09-06 12:45:30 +02:00
run-all-tests.js feat(registry): add ModelScope as a registry source 2026-10-04 16:08:33 +00:00
runtime-specdec-tests.js fix(runtime): honor llama.cpp and Transformers command selection 2026-09-06 12:54:51 +02:00
scoring-unification.test.js fix(#88): unify check/recommend/smart-recommend on one scoring core 2026-06-19 21:08:56 +02:00
selector-memory-sizing.test.js fix: enforce artifact and checkpoint contracts in model rankings 2026-09-06 15:28:57 +02:00
speed-benchmark-sync-restore.test.js fix: retain speed telemetry through failed and incomplete catalog syncs 2026-09-06 12:37:35 +02:00
strix-halo-unified-memory.test.js test: pin Linux platform in the integrated-memory and Strix Halo fixtures 2026-10-13 12:50:53 +02:00
termux-platform-support.test.js fix: add termux platform support 2026-03-07 12:19:00 +01:00
token-speed-estimation.test.js fix(tests): make hardware/perf/cpu/ollama tests hermetic and deterministic 2026-06-10 20:28:33 +02:00
ui-cli-smoke.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
verify-gates.test.js feat: prepare ModelVet 3.8.0 release 2026-08-04 17:11:17 +02:00
virtual-monitor-gpu-detection.test.js fix(hardware): ignore virtual display adapters in GPU detection (#106) 2026-06-22 21:23:42 +02:00
windows-panel-overflow.test.js fix(ui): stop interactive-panel flicker on Windows resize and 46-49 row band (#86) 2026-06-19 21:00:20 +02:00