kvcache-ai-ktransformers/ktransformers/optimize
2024-08-12 11:41:26 +00:00
..
optimize_rules [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
optimize.py [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00