kvcache-ai-ktransformers/ktransformers/optimize
Atream 412055d450 [feature] experts can be injected using CPUInfer
[fix] fix ktransformers interface when use new CUDAGraphRunner
[fix] fix YAML and optimize logic, the top rule has the highest priority
2024-08-14 16:10:54 +08:00
..
optimize_rules [feature] experts can be injected using CPUInfer 2024-08-14 16:10:54 +08:00
optimize.py [feature] experts can be injected using CPUInfer 2024-08-14 16:10:54 +08:00