Ilker ManapandClaude Opus 5.5
7245dbe1dd
Issue #3 asked for commands to stop and start the system, and 05aa21c gave
only one machine's services. Now:
- llmgw stop sets serving.stopped in the cluster's settings, live: the
reconciler wants every model at no replicas, freeing every GPU, and the
gateway answers every POST under /v1/ with 503 system_stopped. The control
planes, agents and mirror keep running, and no model's definition changes.
- llmgw start clears it; every model is placed again as it asks.
- llmgw restart has every agent restart over its stream (RestartAgent), then
the other control planes over ssh, standbys before a leader, then this
one; engines keep serving.
- llmgw status is the cluster's summary, saying when it is stopped.
One machine's services moved to llmgw service status|start|stop|restart.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
12 lines
488 B
Go
12 lines
488 B
Go
package config
|
|
|
|
// ServingSettings is whether the cluster serves at all.
|
|
type ServingSettings struct {
|
|
// Stopped takes every model down and answers every request for one with
|
|
// 503 (system_stopped), leaving the control planes, agents and mirror
|
|
// running and every model's definition as it is: llmgw stop sets it,
|
|
// llmgw start clears it, and the models come back as their catalog
|
|
// entries ask. In force on every control plane within seconds.
|
|
Stopped bool `koanf:"stopped"`
|
|
}
|