Keep native catalog readiness when API metadata lacks credentials, while preserving host auth and explicit runtime policy. Correct observed Muse labels without changing executable identities. Co-authored-by: obviyus <22031114+obviyus@users.noreply.github.com>
18 KiB
| summary | title | read_when | |||
|---|---|---|---|---|---|
| Run OpenClaw embedded agent turns for Meta models through the Muse Code CLI | Muse Code agent runtime |
|
The external @openclaw/muse plugin runs embedded agent turns for meta/*
models through Muse Code, Meta's coding
agent CLI. The plugin starts muse serve and talks to it over the Muse Session
Protocol (MSP) with the official @muse-code/sdk client.
Muse Code owns the low-level agent loop: native shell, file read/write/edit tools, its OS sandbox, and its session state. OpenClaw still owns chat channels, model selection, approvals, the visible chat transcript, and the mapping from OpenClaw sessions to Muse sessions.
For the broader model/provider/runtime split, start with Agent runtimes.
Requirements
-
OpenClaw. Model Setup can install and enable the
@openclaw/museplugin. -
If your config uses
plugins.allow, allowmuse(the manifest id), not the npm package name. -
The Muse Code CLI installed separately, with a
musebinary onPATHor a configuredbinaryPath. Install it with Meta's installer:curl -fsSL https://dev.meta.ai/install.sh | bash muse --version -
A Meta credential: a Muse Code browser sign-in, a stored key, or a
metaauth profile in OpenClaw (see Auth).
Install
Model Setup installs the plugin when you choose Muse Code. To install it manually instead:
openclaw plugins install @openclaw/muse
The plugin does not install or update the muse binary. It sets
MUSE_NO_AUTO_UPDATE=1 on the processes it starts, so Muse does not update
itself in the middle of a Gateway run. Update Muse with its own installer.
Quickstart
- Open Model Setup (
/models) in the Control UI. - In AI Setup, choose Connect provider, then Meta → Muse Code.
- Start sign-in, confirm the displayed device code in the browser, and approve it.
- Accept Use Muse Code’s native permissions? to finish setup for the selected OpenClaw agent.
OpenClaw enables the Muse plugin and selects meta/muse-spark-1.3 with the
muse runtime by default. If you choose another Meta model during setup,
that model uses Muse instead. No terminal login or manual runtime configuration
is needed.
You can also choose Meta → Muse Code in the Provider Access connection dialog. It signs in, verifies access, and enables the Muse runtime without changing the active model. The success dialog confirms Muse Code is connected and names the model ready for your agent using the Gateway's provider catalog, without waiting for a catalog refresh in the browser. Choose Start a new chat with Muse Spark 1.3 to use that model for a new chat, or Close to stay on Provider Access. Use AI Setup to connect and select a default model in one flow.
For manual configuration, route one Meta model through the Muse runtime:
{
agents: {
defaults: {
model: "meta/muse-spark-1.3",
models: {
"meta/muse-spark-1.3": {
agentRuntime: { id: "muse" },
},
},
},
},
}
Set agentRuntime.id on one model entry to route only that model, or on the
meta provider to route every Meta model. Without explicit routing, a model
discovered by exactly one native runtime can use that runtime when no authored
API binding or host credential takes precedence. An API catalog row alone is
not an API credential. Explicit runtime choices and required cloud workers
keep their existing runtime policy.
Choosing Muse Code in Model Setup routes the selected model through Muse for the agent being set up. It writes that agent's model entry, replacing any runtime choice already on it. Global model defaults, other agents and other Meta models keep their existing runtime policy.
The harness accepts only the standard meta provider route on Meta's official
endpoint (https://api.meta.ai/v1). A meta provider entry with another
baseUrl or with request transport overrides is refused, because Muse Code
calls Meta itself.
Model identities and names
Muse's model/list response owns account availability and executable
modelId values. OpenClaw sends the selected ID unchanged to Muse. Display
names are metadata, never routing aliases. Exact same-provider API metadata
can supply a readable name without transferring API capabilities or credentials
to the native offering. The Muse adapter corrects known raw or incorrect labels
for native-only Wonder variants; meaningful upstream labels remain authoritative.
Meta distinguishes Wonder from the higher-capability Wonder Full, and Standard from Contributor mode. These are separate offerings: selecting Wonder, changing reasoning effort, or recommending Wonder does not select or recommend Full or Contributor variants.
Provider slugs remain scoped to their provider and runtime. For example,
openrouter/meta/muse-wonder executes OpenRouter's meta/muse-wonder, while
meta/muse-wonder-1.0 with Muse executes muse-wonder-1.0. Similar branding
does not establish equivalence. When provider evidence establishes that two rows
serve the same upstream model, the existing manifest
upstreamModel authoring field
can record that relationship. It is not a runtime alias and must not rewrite
executable IDs or transfer account readiness. Recommendations
target the intended provider-local IDs independently. Unknown future IDs retain
their supplied label (or raw ID) and remain selectable when discovered, without
guessed relationships or inherited recommendations.
Auth
Use Model Setup → Meta → Muse Code in either Provider Access or AI Setup in the Control UI for browser sign-in. The credential stays in Muse Code's own credential store; OpenClaw does not copy it into an auth profile. This sign-in authorizes the Muse runtime, not the direct Meta API route.
Keep the sign-in dialog open while it shows Waiting for approval in your browser…. The device code and Open sign-in link remain available during the wait. After approval, OpenClaw checks access before showing Muse Code is connected; you can then start a new chat or close the dialog.
Setup shows Testing your AI connection… while checking model access, then Turning on your AI connection… while enabling the runtime and applying the Gateway configuration. The connection is ready when that application completes.
For Muse-owned sign-ins, OpenClaw checks that Muse can fetch the candidate model from Meta's live catalog. It does not run a model turn or expose native tools during verification. The same check runs again before activation is committed. The read-only Muse host is reused while its credential binding stays unchanged; the pre-commit check still requests the live catalog and rechecks caller authority. Canceling sign-in closes its verification host, including during startup. AI Setup selects that model; Provider Access preserves the active model.
Gateway-driven sign-in always uses Muse's file credential backend under the
OpenClaw state directory (muse/muse/auth.json). It needs one browser approval
and does not access the macOS Keychain. Verification and chat use that same
credential directory when its credential file exists.
Before the first sign-in for an agent, OpenClaw asks you to accept Muse Code's
native permissions. Continuing remembers this choice for that agent, so future
Muse chats do not ask again. Muse runs on the Gateway host with its own tools;
OpenClaw's optional native tool and sandbox restrictions do not apply to it.
OpenClaw-hosted tools retain their policy checks. Revoke consent by removing
muse from the agent's Remembered native runtime permissions setting.
Alternatively, run muse login on the Gateway host and approve the browser
code, or store an API key with muse auth set. When no Gateway-managed credential
file exists, the harness uses Muse's own default credential store, including its
native Keychain support, without an OpenClaw auth profile.
The harness picks one credential per attempt, in this order:
- The API key OpenClaw resolved for the attempt's selected
metaauth profile. - The API key from the exact selected
meta:auth profile, resolved through the provider auth runtime. META_API_KEYin the Gateway environment, followed by the Gateway-managed Muse credential file when present; otherwise Muse's own default credential store.
When OpenClaw selects a key, the harness gives it to Muse as META_API_KEY.
The Meta provider's MODEL_API_KEY is not passed to Muse; Muse does not read
it.
Each credential gets its own muse serve process. Changing the key starts a
new Muse session instead of resuming one that belongs to another credential.
Switching between native and Gateway-managed credentials, or changing the
managed credential file, retires the pooled process and starts a fresh session.
If Muse rejects the credential, or finds none, the turn fails. Chat shows
OpenClaw's generic failure notice; the Gateway log (openclaw logs --follow)
carries the actionable cause, for example "Muse Code is not signed in on the
Gateway host ... Run muse login there, or set META_API_KEY for the Gateway",
plus the last lines of Muse's stderr (an invalid META_API_KEY appears only
there).
Configuration
| Key | Default | Purpose |
|---|---|---|
binaryPath |
muse |
Muse executable path, or a command name resolved on PATH. |
{
plugins: {
entries: {
muse: {
enabled: true,
config: { binaryPath: "/opt/homebrew/bin/muse" },
},
},
},
}
Model choice comes from the OpenClaw model ref. The thinking level maps to
Muse's reasoning effort: off becomes minimal (Muse Spark does not accept
none), and minimal, low, medium, high, xhigh, max, and ultra
pass through. adaptive is refused because Muse has no adaptive mode.
Prepared image attachments are forwarded to Muse as native MSP image input, including their media type and base64 payload.
Approvals and sandbox
The harness resolves tools.exec.mode, legacy security/ask settings,
agent-specific settings, and per-session exec overrides in that order.
Explicit modes replace legacy fields in the same layer. Host-local exec approval
defaults and agent-specific approval settings then apply as stricter security
and ask floors; tools.exec.mode: "full" does not bypass them. Only an explicit
full-session elevation can bypass those floors while its effective security
remains full. The effective policy maps to Muse's approval mode and sandbox posture:
| OpenClaw exec policy | Muse behavior |
|---|---|
security: "deny" |
muse serve --disable-shell --disable-write, approval mode denyUnmatched. |
security: "full" with ask: "off" |
Approval mode allowAll. |
| Default and other combinations | Approval mode promptUnmatched: Muse applies its own rules and asks OpenClaw about the rest. |
security: "allowlist" |
Refused. Muse cannot enforce OpenClaw's exec allowlist. |
ask: "always" |
Refused. Muse cannot guarantee an approval prompt for every native command. |
When Muse asks for approval, OpenClaw shows its normal approval prompt with Allow once and Deny to approval surfaces watching the session, such as the Control UI. The harness answers with a choice that Muse offered. A denied, expired, or cancelled approval sends a deny choice, and so does an approval with no surface to show it. Each approval waits up to two minutes. The harness never grants persistent approvals.
The harness also refuses an attempt when OpenClaw requires an OpenClaw sandbox
or workspace-only file access. Muse runs on the Gateway host and cannot enforce
those boundaries. Select the openclaw runtime for those agents or sessions.
A conversation tool policy (for example tools.deny) does not block Muse once
you accept the native-runtime prompt. Muse does not receive OpenClaw's agent
tools, so the policy has nothing to filter, and its own tools follow the
approval mode above. Without that consent, OpenClaw refuses the turn.
Provider Access and AI Setup ask for this permission once, after browser sign-in and before verification. Successful setup remembers your choice for the selected OpenClaw agent, including when you connect Muse without changing the active model. New chats using Muse then start with Full access and optional sandboxing off, without repeating the prompt.
If you set up Muse through the CLI or manual configuration instead, the Control
UI may still offer Continue for this chat when consent is needed. Setup
outside these flows does not grant permission automatically. That fallback
changes only the current chat. Remove muse from
agents.entries.<agentId>.nativeRuntimeConsent to revoke the remembered choice.
Required sandbox and workspace boundaries still apply.
A refused attempt fails before any muse process starts, with an error that
names the setting.
Sessions
The plugin stores one binding per OpenClaw session in its plugin state: the Muse session id plus a fingerprint of the workspace, model, credential, read-only posture, and approval mode. The binding is saved only after Muse accepts the turn. The next turn resumes that Muse session when the fingerprint matches. If any of those inputs changed, or the previous transcript was marked unsafe to replay, the next turn starts a new Muse session. Changes to Muse's own MCP configuration do not start a new session.
If Muse refuses to resume the stored session, the harness starts a new Muse
session and logs why. Muse runs nothing when it refuses a resume, and the
OpenClaw transcript keeps the conversation. This covers a session that no
longer exists and a retained session Muse can no longer open (for example, one
created with a permission profile that needs the subscription's automated
reviewer after muse logout). Transport failures, and sessions Muse reports as
in use or overloaded, fail the turn instead, so a turn that may still be
running is never repeated.
Every fresh Muse session receives the retained OpenClaw conversation branch
before the current prompt, including after a model change, a refused resume, or
a committed history reset. This transfer is bounded by OpenClaw's model-context
reader. If the retained context cannot be read safely within that bound, the
turn fails instead of silently starting without its history; compact the
session or switch to the openclaw runtime.
Fresh sessions also receive OpenClaw workspace bootstrap context, such as
SOUL.md, USER.md, and MEMORY.md, with the normal session, channel, and
bootstrap-mode filters. MSP has no system-message or history-import field, so
the harness prefixes this context to the first native user input. Resumed
sessions do not repeat that prefix.
/new and /reset stop an active Muse turn and delete the binding.
Rewinding or switching branches within the same OpenClaw session also
invalidates the binding, but only after the history change commits.
Stopping a turn waits for Muse's terminal event, not just its interrupt acknowledgement. If Muse does not settle within five seconds, the harness closes the host before releasing the attempt.
muse serve processes are pooled per workspace, credential, and read-only
posture, and shut down after five idle minutes.
Transcript
Each completed Muse item (assistant text, reasoning, tool calls, and tool results) is written to the OpenClaw session transcript as soon as Muse finishes it, keyed by the Muse session and item id so a retried write cannot duplicate entries. A transcript write failure stops the turn.
MCP servers
Muse owns its MCP configuration. Add MCP servers in Muse itself; OpenClaw's
mcp.servers are not passed to Muse sessions.
Limitations
- OpenClaw's own agent tools (messaging,
sessions_spawn, browser, and other OpenClaw tools) are not available to Muse. MSP has no client-tool contract. Muse uses its native tools and its own MCP servers. Replies go back to the channel from the final turn text. - No live steering: a message sent during an active turn waits for the turn to finish.
- No native compaction, isolated completions, or
/btwside questions through Muse./btwuses the configured model provider directly, as on other non-Codex runtimes. - No
ask_user-style questions from Muse. - MSP has no system-instruction field. OpenClaw's extra system prompt is prepended to the user message of each turn.
- Muse runs on the Gateway host only. It is not available with OpenClaw sandboxes or remote node execution.
- Muse's built-in
echoprovider is not available overmuse serve, so the runtime always needs a working Meta credential. - Model Setup checks a new Meta API-key sign-in with a short tool-restricted probe
turn. Muse cannot enforce that restriction, so while
meta/*models are routed tomuse, activating a newmetaAPI key in Model Setup fails with "Muse Code cannot enforce this conversation's tool policy". Use Muse's own sign-in instead (see Auth).
Live tests
# Real `muse` binary, no credentials: handshake, start/resume, auth error, interrupt, exit
OPENCLAW_MUSE_LIVE_HOST=1 node scripts/run-vitest.mjs \
--config test/vitest/vitest.live.config.ts extensions/muse/src/runtime.live.test.ts
# Docker, offline after setup: fake MSP host behind a real Gateway
pnpm test:docker:muse-runtime
# Docker, real Muse: approve the printed MUSE_DEVICE_CODE in the browser,
# or pass OPENCLAW_MUSE_LIVE_KEY=<key> instead of device auth
OPENCLAW_MUSE_LIVE_AUTH=device pnpm test:docker:live-muse
The Docker lanes use disposable Gateways; credentials live only in the
container. The live lane is opt-in and checks a real reply, recall after a
Gateway restart, an allow-once shell approval, and the sign-in error after
muse logout.