vrr/agent-zero
2
0
Fork 0
mirror of https://github.com/agent0ai/agent-zero.git synced 2026-07-09 17:08:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
agent-zero/tools/vision_load.py.dox.md
frdel e138e33ca9 Add file-level DOX docs & update AGENTS indexes 
Add comprehensive file-level DOX documentation across the repo and update directory AGENTS.md indexes. Many new `*.py.dox.md` files were added under api, helpers, tools, plugins, extensions, webui, and other dirs to document endpoint purpose, ownership, runtime contracts, work guidance, and verification. Several AGENTS.md files were created or updated (agents profiles, api, docker, extensions, helpers, plugins, skills, webui components, etc.) to list child DOX files and clarify documentation/work guidance. Also add example and bundled profile DOX files (agent0, default, developer, hacker, researcher) and minor updates to helpers/dirty_json.py and its tests. These changes improve on-disk documentation coverage and establish the convention that each direct runtime file should have a matching `*.dox.md` describing its contracts and verification steps.
2026-06-08 12:41:53 +02:00

2.6 KiB
Raw Blame History

vision_load.py DOX

Purpose

  • Own the vision_load.py agent tool.
  • This module loads images into model-visible content for vision-capable models.
  • Keep this file-level DOX profile synchronized with vision_load.py because this directory is intentionally flat.

Ownership

  • vision_load.py owns the runtime implementation.
  • vision_load.py.dox.md owns durable notes about responsibilities, contracts, side effects, and verification for that implementation.
  • Classes:
  • VisionLoad (Tool)
    • async execute(self, paths: list[str]=..., **kwargs) -> Response
    • async after_execution(self, response: Response, **kwargs)
  • Notable constants/configuration names: TOKENS_ESTIMATE.

Runtime Contracts

  • Tool modules must define helpers.tool.Tool subclasses and return helpers.tool.Response from execute(...).
  • Update this file whenever tool arguments, output shape, break_loop behavior, intervention handling, prompt instructions, or side effects change.
  • VisionLoad is a Tool.
  • VisionLoad defines execute(...).
  • Observed side-effect areas: filesystem writes, model calls, plugin state, settings/state persistence, secret handling.
  • Imported dependency areas include: helpers, helpers.print_style, helpers.tool, mimetypes.

Key Concepts

  • Important called helpers/classes observed in the source: self._get_max_embeds, Response, str.strip, self._context_id, chat_media.infer_source, chat_media.category_for_source, chat_media.save_image_base64, chat_media.save_image_data_url, chat_media.materialize_image_ref, str.strip.lower, ephemeral_images.is_ref, cls._is_data_image_url, self._is_data_image_url, plugins.get_plugin_config, images.to_data_url, normalized.startswith, ephemeral_images.display_ref, join, self.agent.hist_add_tool_result, history.RawMessage.
  • Keep request/response, tool, or helper semantics documented here at the same time as source changes.

Work Guidance

  • Keep tool output concise, model-readable, and safe for history persistence.
  • Coordinate argument or behavior changes with prompt tool instructions and skill guidance.
  • Respect intervention flow for long-running, external, or user-visible operations.

Verification

  • Run targeted tool and prompt-contract tests for changed behavior; smoke-test agent execution when no focused test exists.
  • Related tests observed by source search:
    • tests/test_browser_agent_regressions.py
    • tests/test_host_browser_connector.py
    • tests/test_office_desktop_state.py
    • tests/test_vision_load_image_refs.py

Child DOX Index

No child DOX files.