From f5fef3fbe5d8cada3ec400bf447e3567bc6bc05f Mon Sep 17 00:00:00 2001 From: Eddie Pick Date: Sun, 14 Dec 2025 13:33:58 -0500 Subject: [PATCH] Add AWS Bedrock provider support for chat and embeddings MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit - Add Bedrock to chat providers with native LiteLLM support - Add Bedrock to embedding providers Available models (from AWS docs): Claude: - anthropic.claude-opus-4-5-20251101-v1:0 (Opus 4.5) - anthropic.claude-sonnet-4-5-20250929-v1:0 (Sonnet 4.5) - anthropic.claude-haiku-4-5-20251001-v1:0 (Haiku 4.5) Amazon Nova: - amazon.nova-pro-v1:0, amazon.nova-lite-v1:0 - amazon.nova-2-lite-v1:0, amazon.nova-2-sonic-v1:0 Qwen: - qwen.qwen3-235b-a22b-2507-v1:0 - qwen.qwen3-coder-480b-a35b-v1:0 Others: MiniMax M2, Mistral Large 3, DeepSeek R1/V3, Llama 3.3, Titan Embeddings Auth: Set BEDROCK_API_KEY (new AWS Bedrock API key) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 --- conf/model_providers.yaml | 6 ++++++ requirements.txt | 1 + 2 files changed, 7 insertions(+) diff --git a/conf/model_providers.yaml b/conf/model_providers.yaml index e805376e3..45c964715 100644 --- a/conf/model_providers.yaml +++ b/conf/model_providers.yaml @@ -64,6 +64,9 @@ chat: azure: name: OpenAI Azure litellm_provider: azure + bedrock: + name: AWS Bedrock + litellm_provider: bedrock openrouter: name: OpenRouter litellm_provider: openrouter @@ -110,6 +113,9 @@ embedding: azure: name: OpenAI Azure litellm_provider: azure + bedrock: + name: AWS Bedrock + litellm_provider: bedrock # TODO: OpenRouter not yet supported by LiteLLM, replace with native litellm_provider openrouter and remove api_base when ready openrouter: name: OpenRouter diff --git a/requirements.txt b/requirements.txt index 07be99756..a14a85339 100644 --- a/requirements.txt +++ b/requirements.txt @@ -45,5 +45,6 @@ soundfile==0.13.1 imapclient>=3.0.1 html2text>=2024.2.26 beautifulsoup4>=4.12.3 +boto3>=1.35.0 exchangelib>=5.4.3 pywinpty==3.0.2; sys_platform == "win32" \ No newline at end of file