Let a control plane whose models all live in the database start
Control plane mode was inferred from the config file alone: a model with profiles meant "control plane", nothing meant "router only". So a deployment that manages its catalog at runtime could not start at all — the file declares no models, the process refuses for want of anything to serve, and the stored models it would have loaded are never read. A cluster unmanageable at runtime because it is managed at runtime. control.enabled says so outright. AgentListen cannot carry the signal: it has a default, so every deployment would silently become a control plane. The inference stays, so nothing already working has to add a flag. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
cd7eedf09e
commit
10e323132c
3 files changed
+59
No files matched your search
@@ -65,6 +65,7 @@ rather than repeated.
|
||||
| `lost_after` | `time.Duration` | [Control](#control) |
|
||||
| `port_range` | `[]int` | [Control](#control) |
|
||||
| `mgmt_interface` | `string` | [Control](#control) |
|
||||
| `enabled` | `bool` | [Control](#control) |
|
||||
| `lease_ttl` | `time.Duration` | [Control](#control) |
|
||||
| `id` | `string` | [Endpoint](#endpoint) |
|
||||
| `url` | `string` | [Endpoint](#endpoint) |
|
||||
@@ -485,6 +486,21 @@ PortRange is the per-node range for engine HTTP and dist-init ports.
|
||||
|
||||
MgmtInterface is the ethernet interface NCCL bootstraps over.
|
||||
|
||||
### `enabled`
|
||||
|
||||
`bool`
|
||||
|
||||
Enabled runs the control plane even when configuration declares no
|
||||
models.
|
||||
|
||||
Without it, a deployment whose catalog lives entirely in the database
|
||||
cannot start: control plane mode is inferred from the config file, so an
|
||||
empty models block means "router only", the process refuses to start for
|
||||
want of anything to serve, and the models it would have loaded are never
|
||||
read. That is a cluster that cannot be managed at runtime because it is
|
||||
managed at runtime. AgentListen cannot carry this signal — it has a
|
||||
default, so every deployment would become a control plane.
|
||||
|
||||
### `lease_ttl`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
Reference in new issue
Block a user