mirror of https://github.com/diegosouzapw/OmniRoute.git synced 2026-04-28 06:19:46 +00:00

Diego Rodrigues de Sa e Souza 7388623244

fix(combo): fallback to next model on all-accounts-rate-limited 503 (… (#1523 )

Integrated into release/v3.7.0

2026-04-23 01:53:00 -03:00

4.7 KiB

Raw Blame History

OmniRoute Auto-Combo Engine (Norsk)

🌐 Languages: 🇺🇸 English · 🇸🇦 ar · 🇧🇬 bg · 🇧🇩 bn · 🇨🇿 cs · 🇩🇰 da · 🇩🇪 de · 🇪🇸 es · 🇮🇷 fa · 🇫🇮 fi · 🇫🇷 fr · 🇮🇳 gu · 🇮🇱 he · 🇮🇳 hi · 🇭🇺 hu · 🇮🇩 id · 🇮🇹 it · 🇯🇵 ja · 🇰🇷 ko · 🇮🇳 mr · 🇲🇾 ms · 🇳🇱 nl · 🇳🇴 no · 🇵🇭 phi · 🇵🇱 pl · 🇵🇹 pt · 🇧🇷 pt-BR · 🇷🇴 ro · 🇷🇺 ru · 🇸🇰 sk · 🇸🇪 sv · 🇰🇪 sw · 🇮🇳 ta · 🇮🇳 te · 🇹🇭 th · 🇹🇷 tr · 🇺🇦 uk-UA · 🇵🇰 ur · 🇻🇳 vi · 🇨🇳 zh-CN

Self-managing model chains with adaptive scoring

How It Works

The Auto-Combo Engine dynamically selects the best provider/model for each request using a 6-factor scoring function:

Factor	Weight	Description
Quota	0.20	Remaining capacity [0..1]
Health	0.25	Circuit breaker: CLOSED=1.0, HALF=0.5, OPEN=0.0
CostInv	0.20	Inverse cost (cheaper = higher score)
LatencyInv	0.15	Inverse p95 latency (faster = higher)
TaskFit	0.10	Model × task type fitness score
Stability	0.10	Low variance in latency/errors

Mode Packs

Pack	Focus	Key Weight
🚀 Ship Fast	Speed	latencyInv: 0.35
💰 Cost Saver	Economy	costInv: 0.40
🎯 Quality First	Best model	taskFit: 0.40
📡 Offline Friendly	Availability	quota: 0.40

Self-Healing

Temporary exclusion: Score < 0.2 → excluded for 5 min (progressive backoff, max 30 min)
Circuit breaker awareness: OPEN → auto-excluded; HALF_OPEN → probe requests
Incident mode: >50% OPEN → disable exploration, maximize stability
Cooldown recovery: After exclusion, first request is a "probe" with reduced timeout

Bandit Exploration

5% of requests (configurable) are routed to random providers for exploration. Disabled in incident mode.

API

# Create auto-combo
curl -X POST http://localhost:20128/api/combos/auto \
  -H "Content-Type: application/json" \
  -d '{"id":"my-auto","name":"Auto Coder","candidatePool":["anthropic","google","openai"],"modePack":"ship-fast"}'

# List auto-combos
curl http://localhost:20128/api/combos/auto

Task Fitness

30+ models scored across 6 task types (coding, review, planning, analysis, debugging, documentation). Supports wildcard patterns (e.g., *-coder → high coding score).

Files

File	Purpose
`open-sse/services/autoCombo/scoring.ts`	Scoring function & pool normalization
`open-sse/services/autoCombo/taskFitness.ts`	Model × task fitness lookup
`open-sse/services/autoCombo/engine.ts`	Selection logic, bandit, budget cap
`open-sse/services/autoCombo/selfHealing.ts`	Exclusion, probes, incident mode
`open-sse/services/autoCombo/modePacks.ts`	4 weight profiles
`src/app/api/combos/auto/route.ts`	REST API

4.7 KiB Raw Blame History Unescape Escape