vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-29 20:29:48 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 6
kvcache-ai-ktransformers/ktransformers/ktransformers_ext/bench
History
chenxl 4d1d561d28 [feature] release 0.1.3
2024-08-28 16:11:43 +00:00
..
bench_attention.py [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
bench_attention_torch.py [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
bench_linear.py 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
bench_linear_torch.py 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
bench_mlp.py 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
bench_mlp_torch.py 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
bench_moe.py 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
bench_moe_torch.py 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00