Ilker ManapandClaude Opus 5.5 3d3c96e422 Displace the newest lowest-band request when the gateway queue is full ...

A total bound across bands (admission.queue_capacity_total, default half of
all bands' capacity together); reached, a request is not refused while a
lower band has requests queued, and the newest of the lowest band gets a 503
with Retry-After instead.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-09-30 23:07:53 +02:00

..

choosing-models.md

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

data.md

Answer the two questions asked before a gateway is allowed near anything

2026-09-27 08:16:08 +02:00

fabrics.md

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

facility-aware-placement.md

Mark facility steps 1-5 deferred; node sensors collected

2026-09-30 20:25:50 +02:00

install.md

Sign releases, and install only signed ones once a key is trusted

2026-09-30 23:03:48 +02:00

node-onboarding.md

Add a node with one command: llmgw node add, with a terminal screen

2026-09-29 19:33:47 +02:00

onboarding.md

Document what changed since v0.9.2, and fabrics for the sites that have them

2026-09-29 10:14:58 +02:00

quick-install.md

Put the mirror on its own machine in two commands

2026-09-29 22:17:24 +02:00

quickstart.md

Add a quick install guide: six steps from empty servers to a model

2026-09-29 18:13:05 +02:00

reference.md

Displace the newest lowest-band request when the gateway queue is full

2026-09-30 23:07:53 +02:00