vrr/kvcache-ai-ktransformers
2
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-04-30 04:39:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 6
kvcache-ai-ktransformers/ktransformers/ktransformers_ext/operators/llamafile
History
liam 098602b08f ⚡ v0.2 ongoing
2025-02-09 22:41:14 +08:00
..
conversion.h Initial commit 2024-07-27 16:06:58 +08:00
linear.cpp [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
linear.h 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
mlp.cpp [feature] release 0.1.3 2024-08-28 16:11:43 +00:00
mlp.h 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
moe.cpp ⚡ v0.2 ongoing 2025-02-09 22:41:14 +08:00
moe.h ⚡ v0.2 ongoing 2025-02-09 22:41:14 +08:00
shared_mem_buffer.cpp [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
shared_mem_buffer.h 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00