llmfit/scripts
Brian Gupta d7f2f11bb2 feat: add AWQ/GPTQ support with vLLM inference runtime
Add ModelFormat enum (Gguf/Awq/Gptq/Mlx/Safetensors) and Vllm inference
runtime. Pre-quantized models are detected from config.json by the scraper
and filtered to CUDA/ROCm only (no Apple Silicon support yet). Dynamic
re-quantization is skipped for fixed-precision formats.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-03-10 00:55:16 -04:00
..
__pycache__ feat: increased model count 2026-02-19 08:18:29 +00:00
install-openclaw-skill.sh docs: brew official formula 2026-03-02 11:58:15 +07:00
scrape_hf_models.py feat: add AWQ/GPTQ support with vLLM inference runtime 2026-03-10 00:55:16 -04:00
test_api.py feat: adding serve capabilities 2026-03-03 14:16:31 +00:00
update_models.sh feat: updated models 2026-02-15 21:18:10 +00:00
verify_models.py feat: caught some unavailable models on ollama 2026-02-19 10:40:18 +00:00