Merge C24 facility-aware placement

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
Ilker ManapandClaude Opus 5.5 committed 2026-10-05 01:18:20 +02:00
commit 3ec90ded72
42 files changed
+3510 -63

No files matched your search

+10 -3
View File
@@ -83,11 +83,18 @@ installs. **N** sends a test notification to each webhook in server.yaml's
`notify` section and says how each answered (`llmgw ctl notify test`). A node's and a model's own pages have their charts too, over the
same range.
**Nodes** lists every node with its state, load, GPUs, replicas, disk and
agent version. On a row:
**Nodes** lists every node with its state, where it is (its rack, or row,
room or site, and PDUs), load, GPUs, replicas, disk and agent version. A node
in a held rack reads *ready, held*. On a row:
- **Details** — its address, system, load, engines and GPUs, and any warning.
- **Details** — its address, location and any hold, system, load, engines and
GPUs, and any warning.
- **Cordon** places nothing new on it; **Uncordon** undoes it.
- **Location…** sets its site, room, row, rack and PDUs (the `llmgw.io/`
labels), which placement spreads replicas across.
- **Hold rack …** places nothing new in the node's rack, and can drain it;
**Release …** on a node in a held domain undoes it. See
[facility-aware-placement.md](facility-aware-placement.md).
- **Drain** moves its replicas off one at a time, each replacement up before
the original stops.
- **vllm build / sglang build** (nodes with GPUs) — which build of the engine