vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2025-09-06 20:49:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 2
kvcache-ai-ktransformers/ktransformers/ktransformers_ext/cpu_backend
History
chenht2022 c1cc7d2cd2 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic.
2024-08-08 09:04:36 +00:00
..
backend.cpp Initial commit 2024-07-27 16:06:58 +08:00
backend.h Initial commit 2024-07-27 16:06:58 +08:00
cpuinfer.h 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
task_queue.cpp Initial commit 2024-07-27 16:06:58 +08:00
task_queue.h Initial commit 2024-07-27 16:06:58 +08:00