mirror of
https://github.com/Helldez/BigMoeOnEdge.git
synced 2026-10-03 11:35:50 +00:00
|
Some checks are pending
ci / changes (push) Waiting to run
ci / format (push) Blocked by required conditions
ci / host-linux (push) Blocked by required conditions
ci / host-windows (push) Waiting to run
ci / host-macos (push) Waiting to run
ci / android-apk (push) Waiting to run
On a 12 GB phone this model is capped by its dense side: 4.3 GB pinned and walked every token in the UD-IQ3_XXS, which leaves the expert cache 1000-1500 MiB. Every published dynamic quant keeps that side at 5-8 bit whatever its overall size. DevQuasar's plain Q2_K is the one file with the dense side at 2-4 bit (2.4 GB pinned), at the price of coarser experts (no importance matrix). The entry sits next to the UD file, its blurb states the trade, and the docs that list the catalog follow. |
||
|---|---|---|
| .. | ||
| android | ||