Govern · inference
Model Gateway
Providers & routing
Fallback chain, residency allow-lists and immutable decision audit.
Read-only Agent OS
Providers and fallback chain
Ordered by fallback priority
| Fallback | Provider | Status | Latency | Error rate | Data residency | Cost tier | Models | Allowed tenants |
|---|---|---|---|---|---|---|---|---|
| #1 | Anthropic | healthy | 690 ms | 0.3% | US / EU routing | high | claude-sonnet-4.5claude-haiku-4 | Nordic Federated BankHelios Energy GridMeridian Health Systems |
| #2 | OpenAI | healthy | 780 ms | 0.4% | US / EU routing | high | gpt-4.1gpt-4.1-mini | Nordic Federated BankMeridian Health Systems |
| #3 | Azure OpenAI | healthy | 810 ms | 0.6% | EU (Sweden Central) | high | azure-gpt-4oazure-gpt-4o-mini | Nordic Federated BankHelios Energy GridAtlas Public Sector |
| #4 | AWS Bedrock | healthy | 940 ms | 0.9% | EU (Frankfurt) | medium | bedrock-claude-3.7bedrock-llama-3.1 | Helios Energy GridAtlas Public Sector |
| #5 | Google Gemini | degraded | 1420 ms | 3.1% | US | medium | gemini-2.5-progemini-2.5-flash | Meridian Health Systems |
| #6 | Ollama (on-prem) | healthy | 320 ms | 1.4% | On-premise | low | llama-3.3-70bqwen2.5-32b | Atlas Public SectorHelios Energy Grid |
| #7 | vLLM Cluster | healthy | 410 ms | 1.1% | On-premise (sovereign) | low | llama-3.3-70b (vLLM)mistral-large | Nordic Federated BankAtlas Public Sector |
Routing decision audit log
Immutable gateway decisions with correlation ID · 7 routed · 3 fallback · 2 blocked
| Correlation ID | Time (UTC) | Tenant | Agent | Requested | Chosen provider | Decision | Fallback from | Residency | Latency | Tokens | Outcome |
|---|---|---|---|---|---|---|---|---|---|---|---|
| corr-4830-g2 | 2026-08-02 07:19:05 | Nordic Federated Bank | Supervisor Agent 01 | claude-sonnet-4.5 | Anthropicclaude-sonnet-4.5 | routed | — | EU-West (Ireland) | 396 ms | 26,410 | completedPrimary route healthy |
| corr-4830-g1 | 2026-08-02 07:12:44 | Atlas Public Sector | Planner Agent 02 | gpt-4.1 | — | blocked | — | n/a | — | — | request rejected at gatewayAgent passport expired, gateway refused issuance |
| corr-sec-9002 | 2026-08-02 06:58:00 | Helios Energy Grid | Linux Agent 02 | claude-sonnet-4.5 | Anthropicclaude-sonnet-4.5 | routed | — | EU-West (Ireland) | 371 ms | 4,180 | completed, output redacted by guardrailPrimary route healthy |
| corr-4821-a4 | 2026-08-02 06:48:02 | Nordic Federated Bank | Verification Agent 01 | gemini-2.5-pro | Ollama Edgemistral-small-3 | fallback | Google Gemini | On-premise (sovereign) | 742 ms | 3,260 | completed on edge routeResidency guard: EU-only tenant, provider region unavailable |
| corr-4821-a3 | 2026-08-02 06:45:33 | Nordic Federated Bank | Network Agent 01 | gpt-4.1 | Azure OpenAIazure-gpt-4o | fallback | OpenAI | EU-North (Sweden) | 512 ms | 12,980 | completed on fallback #2Primary p50 latency breached 1200 ms threshold |
| corr-4821-a1 | 2026-08-02 06:41:12 | Nordic Federated Bank | Kubernetes Agent 01 | claude-sonnet-4.5 | Anthropicclaude-sonnet-4.5 | routed | — | EU-West (Ireland) | 384 ms | 18,240 | completedPrimary route healthy, tenant allow-listed |
| corr-sec-9003 | 2026-08-02 06:31:00 | Meridian Health Systems | Kubernetes Agent 03 | gemini-2.5-pro | — | blocked | — | US-Central (denied) | — | — | request rejected at gatewayTenant not on provider allow-list (clinical residency policy) |
| corr-4818-b1 | 2026-08-02 04:15:41 | Nordic Federated Bank | Application Agent 02 | claude-sonnet-4.5 | Anthropicclaude-sonnet-4.5 | routed | — | EU-West (Ireland) | 402 ms | 9,420 | completedPrimary route healthy |
| corr-4809-d1 | 2026-08-01 22:02:10 | Helios Energy Grid | Network Agent 01 | azure-gpt-4o | vLLM Clusterllama-3.3-70b | fallback | Azure OpenAI | On-premise (sovereign) | 688 ms | 21,460 | completed on sovereign routeProvider returned 429 rate limit twice |
| corr-4802-c1 | 2026-08-01 18:33:20 | Meridian Health Systems | Database Agent 01 | llama-3.3-70b | vLLM Clusterllama-3.3-70b | routed | — | On-premise (sovereign) | 610 ms | 15,380 | completedClinical tenant pinned to sovereign inference |
| corr-4795-e1 | 2026-07-31 11:06:44 | Atlas Public Sector | Linux Agent 02 | gpt-4.1 | OpenAIgpt-4.1 | routed | — | EU-West (Ireland) | 441 ms | 7,310 | completedPrimary route healthy |
| corr-4788-f1 | 2026-07-30 08:21:02 | Helios Energy Grid | Application Agent 01 | bedrock-claude-3.7 | AWS Bedrockbedrock-claude-3.7 | routed | — | EU-Central (Frankfurt) | 528 ms | 11,240 | completedCost-tier preference for batch correlation work |