vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-05 12:09:48 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2
kvcache-ai-ktransformers/ktransformers/optimize/optimize_rules
History
wang jiahao 8456222852
Some checks failed
Book-CI / test (push) Has been cancelled
Details
Deploy / deploy (macos-latest) (push) Has been cancelled
Details
Deploy / deploy (ubuntu-latest) (push) Has been cancelled
Details
Deploy / deploy (windows-latest) (push) Has been cancelled
Details
Merge pull request #1276 from kvcache-ai/support_load_safetensor 
support safetensor load, delete architectures argument
2025-05-12 11:10:26 +08:00
..
rocm Fix rocm example yaml 2025-03-15 22:27:02 -04:00
DeepSeek-V2-Chat-multi-gpu-4.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Chat-multi-gpu.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Chat.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Lite-Chat-gpu-cpu.yaml Restore CPU offloading capability 2025-03-21 10:04:31 +08:00
DeepSeek-V2-Lite-Chat-multi-gpu.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
DeepSeek-V2-Lite-Chat.yaml add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
DeepSeek-V3-Chat-amx.yaml support AMX 2025-04-25 14:47:16 +00:00
DeepSeek-V3-Chat-fp8-linear-ggml-experts-serve-amx.yaml support safetensor load, delete architectures argument 2025-05-09 10:38:29 +00:00
DeepSeek-V3-Chat-fp8-linear-ggml-experts-serve.yaml change inject yaml 2025-04-29 08:09:39 +00:00
DeepSeek-V3-Chat-fp8-linear-ggml-experts.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-4.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-8.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-fp8-linear-ggml-experts.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu-marlin.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-multi-gpu.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
DeepSeek-V3-Chat-serve.yaml support qwen3, dont speak human language 2025-04-28 08:44:47 +00:00
DeepSeek-V3-Chat.yaml add balance-serve, support concurrence 2025-03-31 22:55:32 +08:00
Internlm2_5-7b-Chat-1m.yaml [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
Mixtral.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
Moonlight-16B-A3B-serve.yaml support qwen3, dont speak human language 2025-04-28 08:44:47 +00:00
Moonlight-16B-A3B.yaml rm KMoEGateDeepSeekV3, fall back to KMoEGate 2025-04-01 07:13:05 +00:00
Qwen2-57B-A14B-Instruct-multi-gpu.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
Qwen2-57B-A14B-Instruct.yaml optimize gguf dequant, save mem, support Q2_K 2025-02-22 06:13:01 +00:00
Qwen2-serve-amx.yaml support qwen3 2025-04-28 18:15:35 +00:00
Qwen2-serve.yaml support qwen3 2025-04-28 18:15:35 +00:00
Qwen3Moe-serve-amx.yaml support qwen3 2025-04-28 18:15:35 +00:00
Qwen3Moe-serve.yaml support qwen3 2025-04-28 18:15:35 +00:00