agent-zero/plugins/_whisper_stt
Alessandro 0e262f7b87
Some checks are pending
Build And Publish Docker Images / plan (push) Waiting to run
Build And Publish Docker Images / build (push) Blocked by required conditions
Refresh welcome screen and composer
Rework the welcome screen around the shared new-chat composer, renewed quick actions, discovery cards, OAuth accounts, and dedicated system resources panel.

Restore static button colors and neutral surfaces, move microphone state feedback onto the icon, and keep Rubik/code-font composer behavior.

Add focused static regressions for the welcome composer, OAuth discovery panel, and speech button contract.
2026-06-22 15:12:20 +02:00
..
api Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
extensions/webui Refresh welcome screen and composer 2026-06-22 15:12:20 +02:00
helpers Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
webui Refresh welcome screen and composer 2026-06-22 15:12:20 +02:00
AGENTS.md Add file-level DOX docs & update AGENTS indexes 2026-06-08 12:41:53 +02:00
default_config.yaml Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
hooks.py Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
plugin.yaml Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
README.md Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00

Whisper STT

Built-in speech-to-text plugin backed by Whisper.

Responsibilities

  • Registers Whisper as the active STT provider when the plugin is enabled.
  • Owns the microphone runtime, device selector UI, message delivery mode, and plugin APIs.
  • Keeps dependency installation and model bootstrap on the Docker/bootstrap path.

Config

  • model_size: Whisper model name
  • language: language hint or auto
  • message_mode: send to send final transcriptions immediately, or draft to leave them in the composer
  • silence_threshold: frontend threshold before recording starts
  • silence_duration: silence window before waiting state
  • waiting_timeout: delay before transcription dispatch

API

  • POST /api/plugins/_whisper_stt/transcribe
  • POST /api/plugins/_whisper_stt/status