Fallback & Failover

How Aramm routes requests when a primary path is unavailable or unsuitable.

This page will document fallback and failover behavior for inference requests, including the constraints and expected operator controls.

Streaming

How Aramm handles streamed inference responses on the hot path.

Rate Limits

How Aramm enforces request throttling and communicates rate-limit conditions.