vrr/BigMoeOnEdge
2
0
Fork 0
mirror of https://github.com/Helldez/BigMoeOnEdge.git synced 2026-10-03 11:35:50 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
BigMoeOnEdge/.github
History
Exact
Raffaele 10af539a63
feat: prefill on the NPU, decode on the CPU (--prefill-device), in the release APK (#200) 
Wide prefill graphs run on the Hexagon NPU through a two-layer arena streamed from flash; decode stays on the CPU. The app offers it in its own NPU section, off by default, Snapdragon only. A missing or unopenable device leaves the run on the CPU. release-apk builds the Hexagon backend and a skel per NPU generation in a separate, secret-free job. Bundles the llama.cpp bump to bmoe/expert-ready-hook-2609 (K-quants on the NPU). App 0.26.0 (41).
2026-09-28 09:52:46 +02:00
..
ISSUE_TEMPLATE docs: benchmark pages as a contributor guide, and the Apple platform limits 2026-08-28 16:53:22 +02:00
workflows feat: prefill on the NPU, decode on the CPU (--prefill-device), in the release APK (#200) 2026-09-28 09:52:46 +02:00