Ordered request pipeline

Every request โ€” regardless of wire format โ€” runs through the same fixed, cheapest-first stage order.

  • Build order: auth โ†’ token_budget โ†’ security_in โ†’ scratchpad โ†’ summarize โ†’ knowledge โ†’ dedup โ†’ cache โ†’ routing โ†’ dispatch โ†’ security_out โ†’ meter.
  • auth, token_budget, security_in, dispatch, security_out, and meter always run; memory-layer and routing stages are independently feature-flagged.
  • A blocked stage short-circuits the rest of the pipeline โ€” a filtered prompt never reaches a provider.

← Back to all features

Full technical documentation โ†’