diff --git a/README.md b/README.md index 8f34af2..ea08578 100644 --- a/README.md +++ b/README.md @@ -37,8 +37,14 @@ control plane places replicas — including ones larger than a single machine models load when someone asks for them and stop when nobody does, and keys, budgets and rate limits decide who may use any of it. -Before v1.0.0: routing profiles selectable per request, spillover to a fallback -pool, tracing, and reference documentation. One thing is worth saying plainly: +Before v1.0.0: tracing, reference documentation, and filtering on `ctl nodes` +and `ctl replicas` for fleets too large to read a whole table of. Two items +that were on this list are not gaps: a model falls through to its fallbacks +when there is no capacity as well as when a budget is spent, and routing +profiles are chosen by the key rather than by a request header on purpose — +a header would let any client promote itself into the top priority band. + +One thing is worth saying plainly: multi-node replicas are proven on a simulated cluster and on real hardware without a fabric. The InfiniBand, NVML and NCCL paths are written against the formats and failure modes those tools actually have, but they have not yet run