mirror of
https://github.com/Helldez/BigMoeOnEdge.git
synced 2026-10-03 03:25:42 +00:00
1d37057fac
Some checks failed
A session opened with --decide answers which of a list of choices the model would pick, read from the next-token distribution after one prefill, with no decode. The state after a shared prefix is kept and restored when the next prefix extends it. Android app: a Choose from options switch. With --prefill-device, a decision is prefilled by the chat turn's placement rule and keeps no prefix state: llama.cpp saves a sequence through KV views that do not follow the moved model state (gate G18g). Also fixes the engine version, stuck at 0.23.0 since 0.24.0. App 0.27.0 (42). |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| main.cpp | ||