← Back to field notes
Routing2026-07-105 min read

Model routing that explains itself

Why capability, cost, latency, reliability, and organization preference belong in one visible decision.

RoutingPolicyCost control
A routing decision selecting a teal model path among glass model nodes
route / score / select

A model router should not feel like a slot machine. When a request goes to a different model, the developer and platform owner should be able to answer why. Policate makes the decision inspectable by keeping the scoring axes and candidate set visible.

Five axes, one decision

The router evaluates capability, cost, latency, reliability, and organization preference. Policies filter the candidate set first; routing then ranks the models that remain. A deep architectural review can favor capability while a bulk refactor can shift weight toward cost and latency.

That makes routing a product decision the company can tune, rather than a hidden heuristic that only appears in a bill at the end of the month.

A luminous request signal passing through a router toward the most efficient model lane.
Policate keeps the candidate set and the reason for selection visible.
Illustrative model combinations and savings per 1,000 requests
Task classPrimaryFallbackWhy this mixExample / 1k requestsIllustrative saving
Repository searchClaude Haiku 4.5GPT-4o MiniFast retrieval and classification$1.00 / 1k requests80–90%
Feature refactorClaude Sonnet 4.6Claude Haiku 4.5Strong edits with a cheaper retry lane$8.00 / 1k requests35–65%
Architecture reviewClaude Opus 4.8Claude Sonnet 4.6Spend premium quality only where it matters$24.00 / 1k requests10–35%

Fallbacks are part of the contract

A good route is more than a winner. It includes an explainable fallback chain, region constraints, provider health, and an explicit reason a candidate was rejected. The same data powers the Gateway trace and the Direct runtime bundle, where the binary performs the local choice.

Inspect the decision locally
$ policate trace req_84f2