agent-zero/plugins/_whisper_stt
Alessandro 4bf92a6072 Improve Browser startup and annotations
Keep tab loading feedback stable and visible while the interactive Browser starts without waiting for a redundant screenshot.

Add DOM hover feedback, multi-page annotation batches, compact composer-style controls, and shared Whisper draft or send behavior.
2026-08-16 15:22:10 +02:00
..
api Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
extensions/webui Improve Browser startup and annotations 2026-08-16 15:22:10 +02:00
helpers Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
webui Improve Browser startup and annotations 2026-08-16 15:22:10 +02:00
AGENTS.md Improve Browser startup and annotations 2026-08-16 15:22:10 +02:00
default_config.yaml Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
hooks.py Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
plugin.yaml Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00
README.md Refactor speech stack into built-in Kokoro TTS and Whisper STT plugins 2026-05-21 05:41:59 +02:00

Whisper STT

Built-in speech-to-text plugin backed by Whisper.

Responsibilities

  • Registers Whisper as the active STT provider when the plugin is enabled.
  • Owns the microphone runtime, device selector UI, message delivery mode, and plugin APIs.
  • Keeps dependency installation and model bootstrap on the Docker/bootstrap path.

Config

  • model_size: Whisper model name
  • language: language hint or auto
  • message_mode: send to send final transcriptions immediately, or draft to leave them in the composer
  • silence_threshold: frontend threshold before recording starts
  • silence_duration: silence window before waiting state
  • waiting_timeout: delay before transcription dispatch

API

  • POST /api/plugins/_whisper_stt/transcribe
  • POST /api/plugins/_whisper_stt/status