mirror of
https://github.com/QwenLM/qwen-code.git
synced 2026-08-12 10:15:31 +00:00
b9c5e3566b
* feat(voice): voice dictation with native capture, streaming, and biasing
Add voice dictation for the prompt input:
- /voice [hold|tap|off|status] command + general.voice.{enabled,mode,language,protocol} settings; push-to-talk via Space, /model --voice to pick the model
- Native microphone capture (@qwen-code/audio-capture, miniaudio N-API) with arecord/SoX fallback, silence auto-stop, cold-start warm-up, and macOS permission query
- Batch transcription via DashScope Qwen-ASR (OpenAI-compatible chat/completions + input_audio) with language + keyterm biasing and an echo guard
- Live streaming over the DashScope realtime WebSocket (fun-asr-realtime / paraformer-realtime-v2) with interim text and an input-level waveform, behind voice.protocol=dashscope-realtime
- Rich VoiceIndicator UI (state, level meter, live partial transcript)
- Cross-platform prebuilds via prebuildify + node-gyp-build and a CI matrix
Co-authored-by: Qwen-Coder <qwen-coder@alibabacloud.com>
* feat(cli): route voice ASR by model
* feat(cli): polish voice realtime parity
* ci: fix voice workflow checks
* fix(cli): address voice review blockers
* fix(cli): harden voice transcription failures
* fix(cli): address voice PR review blockers
* fix(cli): harden voice review follow-ups
* fix(voice): handle realtime review blockers
* fix(cli): add voice command i18n keys
* fix(cli): address voice review blockers
* fix(cli): address voice review follow-ups
* fix(voice): harden review edge cases
* fix(voice): address release and realtime review blockers
* fix(voice): address realtime suggestion followups
* fix(voice): handle realtime review followups
* fix(voice): address realtime review blockers
* fix(voice): address review feedback
* fix(voice): address recorder review feedback
* docs(voice): document ssrf guard boundary
* fix(voice): address review feedback
* fix(voice): preserve warm recorder session safety
* fix(voice): address stream review suggestions
* fix(voice): address multi-round review findings
Realtime/streaming:
- Salvage an already-committed transcript when the WebSocket closes right
after finish() instead of rejecting the whole dictation
(qwenAsrRealtimeSession, voiceStreamSession) + regression tests.
useVoiceInput state machine:
- Single-shot finalize guard so a tap-stop racing the silence auto-stop can't
double-stop the recorder and surface a spurious failure.
- Reset mountedRef on (re)mount so StrictMode (DEBUG) can't freeze the voice UI.
- Widen the hold-mode first-press release window above common key-repeat delays.
Model selection:
- Reject ids with no ASR transport at /model --voice and in the model dialog via
a new isSelectableVoiceModel; move resolveVoiceTransport into voiceModel so the
record-time config resolver stays transport-agnostic (+ tests).
macOS mic permission:
- Surface the not-determined state in voice warmup so the first dictation isn't
silently lost behind the TCC dialog.
Native packaging:
- Make the audio-capture native install non-fatal (falls back to SoX/arecord) so
a voice-only build failure can't break npm ci.
- Download audio-capture prebuilds before building standalone release archives.
Co-authored-by: Qwen-Coder <qwen-coder@alibabacloud.com>
* fix(voice): address review blockers
* fix(voice): update batch recording audio level
* fix(voice): tap-mode transcript loss, stream leaks, and dead keyterm cleanup
- Tap-mode dictation submitted a stale empty buffer.text, wiping the just-
inserted transcript and sending nothing: thread the resulting prompt text
through onSubmit(text) instead of reading buffer.text back synchronously
after the async insert (useVoiceInput, InputPrompt).
- Streaming finalize leaked the WebSocket session when recorder.drain() threw:
abort the session before propagating the error.
- voiceStreamSession: reject the connect promise when 'task-finished' arrives
before 'task-started' instead of hanging forever in 'transcribing'.
- Remove dead keyterm enrichment (project/branch/recent-file paths were
unreachable after the privacy fix) and the now-inert CJK echo guard, plus the
tests that asserted that removed behavior; fix the misleading "OpenAI prompt
field" comment.
- Add the missing 'Voice Model' and macOS mic-permission i18n keys to
en/zh/zh-TW (they were falling back to English; check-i18n doesn't flag keys
absent from en).
Co-authored-by: Qwen-Coder <qwen-coder@alibabacloud.com>
* fix(voice): reject partial stream transcripts
* fix(cli): let dialogs consume voice keys first
* fix(voice): reject incomplete qwen realtime transcripts
* fix(voice): handle stream review blockers
* fix(voice): salvage qwen realtime transcript on close
* fix(voice): sanitize streamed transcript text
* test(audio): run audio capture tests in CI
* fix(voice): address review blockers
* fix(voice): report stream close while recording
* fix(voice): reduce keyterm echo false positives
* fix(voice): handle realtime close diagnostics
* fix(voice): address realtime review blockers
* fix(lint): allow legacy voice filenames
* chore(cli): rename voice files to kebab-case
---------
Co-authored-by: Qwen-Coder <qwen-coder@alibabacloud.com>
108 lines
4.1 KiB
JSON
108 lines
4.1 KiB
JSON
{
|
|
"extends": "../../tsconfig.json",
|
|
"compilerOptions": {
|
|
"outDir": "dist",
|
|
"jsx": "react-jsx",
|
|
"baseUrl": ".",
|
|
"lib": ["DOM", "DOM.Iterable", "ES2023"],
|
|
"types": ["node", "vitest/globals"],
|
|
"paths": {
|
|
"@qwen-code/qwen-code-core": ["../core/src/index.ts"],
|
|
"@qwen-code/qwen-code-core/*": ["../core/src/*"],
|
|
"@qwen-code/acp-bridge": ["../acp-bridge/src/index.ts"],
|
|
"@qwen-code/acp-bridge/*": ["../acp-bridge/src/*"],
|
|
"@qwen-code/audio-capture": ["../audio-capture/src/index.ts"],
|
|
"@qwen-code/audio-capture/*": ["../audio-capture/src/*"]
|
|
}
|
|
},
|
|
"include": [
|
|
"index.ts",
|
|
"src/**/*.ts",
|
|
"src/**/*.tsx",
|
|
"src/**/*.json",
|
|
"./package.json",
|
|
"../core/src/utils/toml-to-markdown-converter.test.ts",
|
|
"../core/src/utils/toml-to-markdown-converter.ts"
|
|
],
|
|
"exclude": [
|
|
"node_modules",
|
|
"dist",
|
|
// TODO(5691): Fix type errors and remove excludes.
|
|
"src/commands/mcp.test.ts",
|
|
"src/commands/mcp/add.test.ts",
|
|
"src/commands/mcp/list.test.ts",
|
|
"src/commands/mcp/remove.test.ts",
|
|
"src/commands/mcp/reconnect.test.ts",
|
|
"src/config/config.integration.test.ts",
|
|
"src/config/config.test.ts",
|
|
"src/config/extension.test.ts",
|
|
"src/config/settings.test.ts",
|
|
"src/nonInteractiveCli.test.ts",
|
|
"src/services/FileCommandLoader.test.ts",
|
|
"src/services/prompt-processors/argumentProcessor.test.ts",
|
|
"src/serve/auth.test.ts",
|
|
"src/serve/server.test.ts",
|
|
"src/utils/cleanup.test.ts",
|
|
"src/utils/handleAutoUpdate.test.ts",
|
|
"src/utils/startupWarnings.test.ts",
|
|
"src/ui/App.test.tsx",
|
|
"src/ui/commands/aboutCommand.test.ts",
|
|
"src/ui/commands/authCommand.test.ts",
|
|
"src/ui/commands/bugCommand.test.ts",
|
|
"src/ui/commands/clearCommand.test.ts",
|
|
"src/ui/commands/compressCommand.test.ts",
|
|
"src/ui/commands/copyCommand.test.ts",
|
|
"src/ui/commands/docsCommand.test.ts",
|
|
"src/ui/commands/editorCommand.test.ts",
|
|
"src/ui/commands/extensionsCommand.test.ts",
|
|
"src/ui/commands/helpCommand.test.ts",
|
|
"src/ui/commands/restoreCommand.test.ts",
|
|
"src/ui/commands/settingsCommand.test.ts",
|
|
"src/ui/commands/themeCommand.test.ts",
|
|
"src/ui/commands/chatCommand.test.ts",
|
|
"src/ui/commands/directoryCommand.test.tsx",
|
|
"src/ui/commands/ideCommand.test.ts",
|
|
"src/ui/commands/initCommand.test.ts",
|
|
"src/ui/commands/quitCommand.test.ts",
|
|
"src/ui/commands/mcpCommand.test.ts",
|
|
"src/ui/commands/memoryCommand.test.ts",
|
|
"src/ui/commands/statsCommand.test.ts",
|
|
"src/ui/commands/terminalSetupCommand.test.ts",
|
|
"src/ui/commands/toolsCommand.test.ts",
|
|
"src/ui/components/ContextSummaryDisplay.test.tsx",
|
|
"src/ui/components/Footer.test.tsx",
|
|
"src/ui/components/InputPrompt.test.tsx",
|
|
"src/ui/components/ModelStatsDisplay.test.tsx",
|
|
"src/ui/components/SessionSummaryDisplay.test.tsx",
|
|
"src/ui/components/shared/text-buffer.test.ts",
|
|
"src/ui/components/shared/vim-buffer-actions.test.ts",
|
|
"src/ui/components/StatsDisplay.test.tsx",
|
|
"src/ui/components/ToolStatsDisplay.test.tsx",
|
|
"src/ui/components/WarningMessage.test.tsx",
|
|
"src/ui/contexts/SessionContext.test.tsx",
|
|
"src/ui/hooks/slashCommandProcessor.test.ts",
|
|
"src/ui/hooks/useAtCompletion.test.ts",
|
|
"src/ui/hooks/useConsoleMessages.test.ts",
|
|
"src/ui/hooks/useCommandCompletion.test.ts",
|
|
"src/ui/hooks/useFocus.test.ts",
|
|
"src/ui/hooks/useFolderTrust.test.ts",
|
|
"src/ui/hooks/useGeminiStream.test.tsx",
|
|
"src/ui/hooks/useKeypress.test.ts",
|
|
"src/ui/hooks/usePhraseCycler.test.ts",
|
|
"src/ui/utils/computeStats.test.ts",
|
|
"src/ui/themes/theme.test.ts",
|
|
"src/validateNonInterActiveAuth.test.ts",
|
|
"src/services/prompt-processors/shellProcessor.test.ts",
|
|
"src/commands/extensions/examples/**"
|
|
],
|
|
"references": [
|
|
{ "path": "../core" },
|
|
{ "path": "../acp-bridge" },
|
|
{ "path": "../audio-capture" },
|
|
{ "path": "../channels/base" },
|
|
{ "path": "../channels/telegram" },
|
|
{ "path": "../channels/weixin" },
|
|
{ "path": "../channels/dingtalk" },
|
|
{ "path": "../channels/feishu" }
|
|
]
|
|
}
|