vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-01 01:59:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
kvcache-ai-ktransformers/ktransformers/optimize/optimize_rules
History
Exact
djw 48bc6185b5 support smt and qlm4
2025-07-25 12:48:51 +00:00
..
rocm Fix rocm example yaml 2025-03-15 22:27:02 -04:00
xpu add XPU support for qwen3moe local chat 2025-05-22 21:01:41 +08:00
DeepSeek-V2-Chat-multi-gpu-4.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Chat-multi-gpu.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Chat.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Lite-Chat-gpu-cpu.yaml Restore CPU offloading capability 2025-03-21 10:04:31 +08:00
DeepSeek-V2-Lite-Chat-multi-gpu.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Lite-Chat.yaml add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
DeepSeek-V3-Chat-amx.yaml support AMX 2025-04-25 14:47:16 +00:00
DeepSeek-V3-Chat-fp8-linear-ggml-experts-serve-amx.yaml support safetensor load, delete architectures argument 2025-05-09 10:38:29 +00:00
DeepSeek-V3-Chat-fp8-linear-ggml-experts-serve.yaml change inject yaml 2025-04-29 08:09:39 +00:00
DeepSeek-V3-Chat-fp8-linear-ggml-experts.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-4.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-8.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-fp8-linear-ggml-experts.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-marlin.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-serve.yaml support qwen3, dont speak human language 2025-04-28 08:44:47 +00:00
DeepSeek-V3-Chat.yaml add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
Glm4Moe-serve.yaml support smt and qlm4 2025-07-25 12:48:51 +00:00
Internlm2_5-7b-Chat-1m.yaml [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
Mixtral.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
Moonlight-16B-A3B-serve.yaml support qwen3, dont speak human language 2025-04-28 08:44:47 +00:00
Moonlight-16B-A3B.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
Qwen2-57B-A14B-Instruct-multi-gpu.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
Qwen2-57B-A14B-Instruct.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
Qwen2-serve-amx.yaml support qwen3 2025-04-28 18:15:35 +00:00
Qwen2-serve.yaml support qwen3 2025-04-28 18:15:35 +00:00
Qwen3Moe-serve-amx.yaml support qwen3 2025-04-28 18:15:35 +00:00
Qwen3Moe-serve.yaml support qwen3 2025-04-28 18:15:35 +00:00
Smallthinker-serve.yaml support smt and glm4 2025-07-24 09:39:19 +00:00