vrr/agent-zero
2
0
Fork 0
mirror of https://github.com/agent0ai/agent-zero.git synced 2026-07-09 17:08:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
agent-zero/helpers/llm_result.py.dox.md
Alessandro 9bcef39028 Add llama.cpp and vLLM local providers 
Add llama.cpp / llama-server support:
- Register llama.cpp chat and embedding providers through hosted_vllm defaults on host.docker.internal:8080.
- Add onboarding metadata, a bundled icon, no-key provider metadata, model discovery coverage, setup docs, and tests.

Add vLLM support:
- Register vLLM chat and embedding providers through hosted_vllm defaults on host.docker.internal:8000.
- Add onboarding metadata, a bundled icon, no-key provider metadata, model discovery coverage, setup docs, and tests.
- Strip empty tools arrays from the Responses-to-chat fallback path so strict OpenAI-compatible servers accept local vLLM calls.
2026-06-15 05:37:28 +02:00

1.8 KiB
Raw Blame History

llm_result.py DOX

Purpose

  • Own canonical LLM result metadata shared by model transports, history, and tool-result processing.
  • Preserve Responses API output items, provider response IDs, reasoning text, usage, and capability metadata in a serializable form.

Ownership

  • llm_result.py owns the runtime implementation.
  • llm_result.py.dox.md owns durable notes about responsibilities, contracts, side effects, and verification for that implementation.
  • Classes:
  • ResponseItem
  • ResponseFunctionCall
  • LLMResult
  • Top-level functions include metadata conversion, function-call output item construction, object normalization, output-text extraction, reasoning extraction, and function-call argument parsing.

Runtime Contracts

  • LLMResult.metadata() stores data under RESPONSE_METADATA_KEY so history can round-trip provider state.
  • from_response(...) must preserve provider response_id, previous_response_id, raw output items, usage, and capability metadata.
  • from_chat(...) must produce an equivalent chat-completions result with mode="chat_completions" and state="off".
  • Function-call output items must preserve call_id and optional acknowledged safety checks.
  • Argument parsing must tolerate JSON strings, dictionaries, and malformed values without throwing.

Work Guidance

  • Keep metadata backward-compatible with existing serialized chat history.
  • Treat unknown response item types as preserved built-in items unless they are local function calls, message text, or reasoning.
  • Avoid provider-specific assumptions in result parsing.

Verification

  • Run pytest tests/test_responses_architecture.py -q after changing result metadata behavior.
  • Run focused history/tool-processing tests when changing function-call serialization.

Child DOX Index

No child DOX files.