Watch the cluster and edit every setting from the console
The console gains live views of nodes, GPUs, models, replicas, usage and agent logs, and a settings tree over every key of server.yaml (agent.yaml on a node), generated from the configuration structs: values with their defaults and doc comments, edited in dialogs, saved only once the service's own loader accepts them, comments kept. The generator now tells blocks apart by package, which brings the TLS, engine and supervisor settings back into the reference. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
aa3efcebbe
commit
9ab93a0aa6
13 files changed
+2702
-472
No files matched your search
+395
-197
@@ -39,31 +39,9 @@ rather than repeated.
|
||||
| `flush_interval` | `time.Duration` | [Auth](#auth) |
|
||||
| `batch_size` | `int` | [Auth](#auth) |
|
||||
| `buffer_size` | `int` | [Auth](#auth) |
|
||||
| `name` | `string` | [Band](#band) |
|
||||
| `priority` | `int` | [Band](#band) |
|
||||
| `saturation_ceiling` | `float64` | [Band](#band) |
|
||||
| `tools` | `bool` | [Capabilities](#capabilities) |
|
||||
| `vision` | `bool` | [Capabilities](#capabilities) |
|
||||
| `embeddings` | `bool` | [Capabilities](#capabilities) |
|
||||
| `node_id` | `string` | [Config](#config) |
|
||||
| `server` | `string` | [Config](#config) |
|
||||
| `servers` | `[]string` | [Config](#config) |
|
||||
| `hostname` | `string` | [Config](#config) |
|
||||
| `mgmt_addr` | `string` | [Config](#config) |
|
||||
| `labels` | `map[string]string` | [Config](#config) |
|
||||
| `mgmt_interface` | `string` | [Config](#config) |
|
||||
| `fabrics` | `[]inventory.FabricAttachment` | [Config](#config) |
|
||||
| `heartbeat_interval` | `time.Duration` | [Config](#config) |
|
||||
| `reconnect_base` | `time.Duration` | [Config](#config) |
|
||||
| `reconnect_max` | `time.Duration` | [Config](#config) |
|
||||
| `adopt_ready_timeout` | `time.Duration` | [Config](#config) |
|
||||
| `tls` | `tlsconf.Config` | [Config](#config) |
|
||||
| `model_dirs` | `[]string` | [Config](#config) |
|
||||
| `engines_dir` | `string` | [Config](#config) |
|
||||
| `weights_cache` | `string` | [Config](#config) |
|
||||
| `discovery` | `discovery.Options` | [Config](#config) |
|
||||
| `engines` | `engines.Config` | [Config](#config) |
|
||||
| `supervisor` | `supervisor.Config` | [Config](#config) |
|
||||
| `interval` | `time.Duration` | [Control](#control) |
|
||||
| `base_backoff` | `time.Duration` | [Control](#control) |
|
||||
| `max_backoff` | `time.Duration` | [Control](#control) |
|
||||
@@ -132,8 +110,6 @@ rather than repeated.
|
||||
| `match_ratio` | `float64` | [Prefix](#prefix) |
|
||||
| `balance_abs` | `float64` | [Prefix](#prefix) |
|
||||
| `balance_rel` | `float64` | [Prefix](#prefix) |
|
||||
| `prompt_per_1k` | `int64` | [Price](#price) |
|
||||
| `completion_per_1k` | `int64` | [Price](#price) |
|
||||
| `name` | `string` | [Profile](#profile) |
|
||||
| `engine` | `string` | [Profile](#profile) |
|
||||
| `gpu_class` | `string` | [Profile](#profile) |
|
||||
@@ -208,6 +184,56 @@ rather than repeated.
|
||||
| `bin` | `string` | [VLLMConfig](#vllmconfig) |
|
||||
| `launch_mode` | `string` | [VLLMConfig](#vllmconfig) |
|
||||
| `ray_bin` | `string` | [VLLMConfig](#vllmconfig) |
|
||||
| `prompt_per_1k` | `int64` | [accounting.Price](#accountingprice) |
|
||||
| `completion_per_1k` | `int64` | [accounting.Price](#accountingprice) |
|
||||
| `name` | `string` | [admission.Band](#admissionband) |
|
||||
| `priority` | `int` | [admission.Band](#admissionband) |
|
||||
| `saturation_ceiling` | `float64` | [admission.Band](#admissionband) |
|
||||
| `bands` | `[]Band` | [admission.Config](#admissionconfig) |
|
||||
| `default_band` | `string` | [admission.Config](#admissionconfig) |
|
||||
| `queue_ttl` | `time.Duration` | [admission.Config](#admissionconfig) |
|
||||
| `queue_capacity_per_band` | `int` | [admission.Config](#admissionconfig) |
|
||||
| `queue_capacity_total` | `int` | [admission.Config](#admissionconfig) |
|
||||
| `interval` | `time.Duration` | [admission.Config](#admissionconfig) |
|
||||
| `node_id` | `string` | [agent.Config](#agentconfig) |
|
||||
| `server` | `string` | [agent.Config](#agentconfig) |
|
||||
| `servers` | `[]string` | [agent.Config](#agentconfig) |
|
||||
| `hostname` | `string` | [agent.Config](#agentconfig) |
|
||||
| `mgmt_addr` | `string` | [agent.Config](#agentconfig) |
|
||||
| `labels` | `map[string]string` | [agent.Config](#agentconfig) |
|
||||
| `mgmt_interface` | `string` | [agent.Config](#agentconfig) |
|
||||
| `fabrics` | `[]inventory.FabricAttachment` | [agent.Config](#agentconfig) |
|
||||
| `heartbeat_interval` | `time.Duration` | [agent.Config](#agentconfig) |
|
||||
| `reconnect_base` | `time.Duration` | [agent.Config](#agentconfig) |
|
||||
| `reconnect_max` | `time.Duration` | [agent.Config](#agentconfig) |
|
||||
| `adopt_ready_timeout` | `time.Duration` | [agent.Config](#agentconfig) |
|
||||
| `tls` | `tlsconf.Config` | [agent.Config](#agentconfig) |
|
||||
| `model_dirs` | `[]string` | [agent.Config](#agentconfig) |
|
||||
| `engines_dir` | `string` | [agent.Config](#agentconfig) |
|
||||
| `weights_cache` | `string` | [agent.Config](#agentconfig) |
|
||||
| `discovery` | `discovery.Options` | [agent.Config](#agentconfig) |
|
||||
| `engines` | `engines.Config` | [agent.Config](#agentconfig) |
|
||||
| `supervisor` | `supervisor.Config` | [agent.Config](#agentconfig) |
|
||||
| `name` | `string` | [config.Band](#configband) |
|
||||
| `priority` | `int` | [config.Band](#configband) |
|
||||
| `saturation_ceiling` | `float64` | [config.Band](#configband) |
|
||||
| `prompt_per_1k` | `int64` | [config.Price](#configprice) |
|
||||
| `completion_per_1k` | `int64` | [config.Price](#configprice) |
|
||||
| `disabled` | `[]string` | [engines.Config](#enginesconfig) |
|
||||
| `vllm` | `VLLMConfig` | [engines.Config](#enginesconfig) |
|
||||
| `sglang` | `SGLangConfig` | [engines.Config](#enginesconfig) |
|
||||
| `llamacpp` | `LlamaCppConfig` | [engines.Config](#enginesconfig) |
|
||||
| `sim` | `SimConfig` | [engines.Config](#enginesconfig) |
|
||||
| `work_dir` | `string` | [supervisor.Config](#supervisorconfig) |
|
||||
| `log_lines` | `int` | [supervisor.Config](#supervisorconfig) |
|
||||
| `stop_timeout` | `time.Duration` | [supervisor.Config](#supervisorconfig) |
|
||||
| `health_interval` | `time.Duration` | [supervisor.Config](#supervisorconfig) |
|
||||
| `rendezvous_timeout` | `time.Duration` | [supervisor.Config](#supervisorconfig) |
|
||||
| `alive_grace` | `time.Duration` | [supervisor.Config](#supervisorconfig) |
|
||||
| `ca` | `string` | [tlsconf.Config](#tlsconfconfig) |
|
||||
| `cert` | `string` | [tlsconf.Config](#tlsconfconfig) |
|
||||
| `key` | `string` | [tlsconf.Config](#tlsconfconfig) |
|
||||
| `insecure` | `bool` | [tlsconf.Config](#tlsconfconfig) |
|
||||
|
||||
## Adapter
|
||||
|
||||
@@ -347,7 +373,7 @@ table costs whatever DefaultPrice says, which is nothing unless set.
|
||||
|
||||
`Price`
|
||||
|
||||
Takes a [Price](#price) block.
|
||||
Takes a [config.Price](#configprice) block.
|
||||
|
||||
### `flush_interval`
|
||||
|
||||
@@ -367,20 +393,6 @@ BufferSize bounds the queue. Beyond it records are dropped rather than
|
||||
blocking a request: losing accounting is bad, turning a stalled database
|
||||
into an outage is worse.
|
||||
|
||||
## Band
|
||||
|
||||
### `name`
|
||||
|
||||
`string`
|
||||
|
||||
### `priority`
|
||||
|
||||
`int`
|
||||
|
||||
### `saturation_ceiling`
|
||||
|
||||
`float64`
|
||||
|
||||
## Capabilities
|
||||
|
||||
### `tools`
|
||||
@@ -395,152 +407,6 @@ into an outage is worse.
|
||||
|
||||
`bool`
|
||||
|
||||
## Config
|
||||
|
||||
### `node_id`
|
||||
|
||||
`string`
|
||||
|
||||
NodeID defaults to the hostname. It must equal the common name of the
|
||||
agent's certificate, so set it only where the two differ.
|
||||
|
||||
### `server`
|
||||
|
||||
`string`
|
||||
|
||||
Server is the control plane, and Servers is the same thing when there is
|
||||
more than one. Both are accepted: every configuration written before
|
||||
there could be a second control plane names one address, and none of
|
||||
them should have to change.
|
||||
|
||||
The order is tried in order, and a refusal moves to the next. Only the
|
||||
leader accepts an agent, so a standby is skipped in the time it takes to
|
||||
be told so — which is what makes failover a reconnect rather than an
|
||||
edit to every node's configuration.
|
||||
|
||||
### `servers`
|
||||
|
||||
`[]string`
|
||||
|
||||
### `hostname`
|
||||
|
||||
`string`
|
||||
|
||||
Hostname defaults to the machine's.
|
||||
|
||||
### `mgmt_addr`
|
||||
|
||||
`string`
|
||||
|
||||
MgmtAddr is the address engines are reached on. It defaults to this
|
||||
machine's address on the route to the control plane, which is the one
|
||||
the control plane and the router can reach.
|
||||
|
||||
### `labels`
|
||||
|
||||
`map[string]string`
|
||||
|
||||
Labels are free-form facts about a node for a profile's node_selector.
|
||||
Nothing needs them: memory, GPUs, engines and disk are measured, and a
|
||||
label restating one of those goes stale the day the machine changes.
|
||||
|
||||
### `mgmt_interface`
|
||||
|
||||
`string`
|
||||
|
||||
MgmtInterface is the ethernet interface NCCL bootstraps over. It
|
||||
defaults to the interface holding MgmtAddr, then eth0.
|
||||
|
||||
### `fabrics`
|
||||
|
||||
`[]inventory.FabricAttachment`
|
||||
|
||||
Fabrics labels this node's HCAs. It is explicit on purpose: OpenSM's
|
||||
default subnet prefix is the same on every fabric, so nothing can be
|
||||
inferred from the wire (plan §5.2).
|
||||
|
||||
### `heartbeat_interval`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
### `reconnect_base`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
ReconnectBase is the first reconnect delay; it backs off from there.
|
||||
|
||||
### `reconnect_max`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
### `adopt_ready_timeout`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
AdoptReadyTimeout bounds how long an adopted engine is given to answer a
|
||||
health check before the agent stops waiting on it.
|
||||
|
||||
Shorter than a startup timeout on purpose: this engine is already
|
||||
running, so it is not loading a model, it is either serving or it is not.
|
||||
|
||||
### `tls`
|
||||
|
||||
`tlsconf.Config`
|
||||
|
||||
TLS authenticates both ends of the control-plane stream. Leaving it unset
|
||||
keeps the plaintext behaviour, which only belongs on a trusted network.
|
||||
|
||||
Takes a [Config](#config) block.
|
||||
|
||||
### `model_dirs`
|
||||
|
||||
`[]string`
|
||||
|
||||
ModelDirs are the directories this node keeps model weights in, beyond
|
||||
WeightsCache, which is always looked in. Storage differs at every installation,
|
||||
so llmgw observes it rather than owning it: a Lustre mount, an image
|
||||
exported over the fabric, local NVMe and a copy made by hand all look
|
||||
identical from here, and placement only needs to know whether the file
|
||||
is present.
|
||||
|
||||
### `engines_dir`
|
||||
|
||||
`string`
|
||||
|
||||
EnginesDir is where the agent installs engines, one directory per
|
||||
build. Defaults to /opt/llmgw/engines.
|
||||
|
||||
### `weights_cache`
|
||||
|
||||
`string`
|
||||
|
||||
WeightsCache is where a remote source is downloaded to. Defaults to the
|
||||
first entry of ModelDirs, because a node that says where its models live
|
||||
has already answered this question, and otherwise to
|
||||
/var/lib/llmgw-weights.
|
||||
|
||||
Fetching is the simple arrangement: every node keeps its own copy. The
|
||||
exotic ones need no code — weights on a shared filer or an image exported
|
||||
over the fabric are simply present, and present means nothing is fetched.
|
||||
|
||||
### `discovery`
|
||||
|
||||
`discovery.Options`
|
||||
|
||||
Takes a [Options](#options) block.
|
||||
|
||||
### `engines`
|
||||
|
||||
`engines.Config`
|
||||
|
||||
Takes a [Config](#config) block.
|
||||
|
||||
### `supervisor`
|
||||
|
||||
`supervisor.Config`
|
||||
|
||||
Takes a [Config](#config) block.
|
||||
|
||||
## Control
|
||||
|
||||
### `interval`
|
||||
@@ -769,7 +635,7 @@ agents use. Empty leaves the connection in plain HTTP, which is only
|
||||
acceptable on a network where nothing untrusted can reach that port —
|
||||
the mirror says as much in its own log when it starts that way.
|
||||
|
||||
Takes a [Config](#config) block.
|
||||
Takes a [tlsconf.Config](#tlsconfconfig) block.
|
||||
|
||||
### `registry`
|
||||
|
||||
@@ -1031,16 +897,6 @@ before affinity is abandoned.
|
||||
|
||||
`float64`
|
||||
|
||||
## Price
|
||||
|
||||
### `prompt_per_1k`
|
||||
|
||||
`int64`
|
||||
|
||||
### `completion_per_1k`
|
||||
|
||||
`int64`
|
||||
|
||||
## Profile
|
||||
|
||||
### `name`
|
||||
@@ -1402,7 +1258,7 @@ AgentTLS authenticates the fleet-facing port. It deliberately does not
|
||||
cover the client-facing one: that surface is fronted by a publicly
|
||||
trusted certificate, while this one is mutual and private.
|
||||
|
||||
Takes a [Config](#config) block.
|
||||
Takes a [tlsconf.Config](#tlsconfconfig) block.
|
||||
|
||||
### `monitoring`
|
||||
|
||||
@@ -1594,3 +1450,345 @@ node and has not been checked against a real cluster.
|
||||
|
||||
RayBin is used when LaunchMode is "ray".
|
||||
|
||||
## accounting.Price
|
||||
|
||||
### `prompt_per_1k`
|
||||
|
||||
`int64`
|
||||
|
||||
### `completion_per_1k`
|
||||
|
||||
`int64`
|
||||
|
||||
## admission.Band
|
||||
|
||||
### `name`
|
||||
|
||||
`string`
|
||||
|
||||
### `priority`
|
||||
|
||||
`int`
|
||||
|
||||
Priority orders bands; higher is served first.
|
||||
|
||||
### `saturation_ceiling`
|
||||
|
||||
`float64`
|
||||
|
||||
SaturationCeiling is the pool saturation above which this band waits.
|
||||
1.0 means "never hold this band back".
|
||||
|
||||
## admission.Config
|
||||
|
||||
### `bands`
|
||||
|
||||
`[]Band`
|
||||
|
||||
### `default_band`
|
||||
|
||||
`string`
|
||||
|
||||
### `queue_ttl`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
QueueTTL drops a request that has waited this long. Sending the GPU work
|
||||
the client has already given up on helps nobody.
|
||||
|
||||
### `queue_capacity_per_band`
|
||||
|
||||
`int`
|
||||
|
||||
QueueCapacityPerBand bounds each band's queue. Rejecting immediately
|
||||
beats accumulating silently.
|
||||
|
||||
### `queue_capacity_total`
|
||||
|
||||
`int`
|
||||
|
||||
QueueCapacityTotal bounds everything queued, across bands. When it is
|
||||
reached, a request is not refused while a lower band has requests
|
||||
queued: the newest of the lowest band is turned away instead
|
||||
(displacement), since the oldest have waited longest and are nearest
|
||||
their TTL. Zero takes half of every band's capacity together.
|
||||
|
||||
### `interval`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
Interval is how often the dispatcher re-checks saturation. Releases also
|
||||
wake it, so this is only the backstop for saturation falling on its own.
|
||||
|
||||
## agent.Config
|
||||
|
||||
### `node_id`
|
||||
|
||||
`string`
|
||||
|
||||
NodeID defaults to the hostname. It must equal the common name of the
|
||||
agent's certificate, so set it only where the two differ.
|
||||
|
||||
### `server`
|
||||
|
||||
`string`
|
||||
|
||||
Server is the control plane, and Servers is the same thing when there is
|
||||
more than one. Both are accepted: every configuration written before
|
||||
there could be a second control plane names one address, and none of
|
||||
them should have to change.
|
||||
|
||||
The order is tried in order, and a refusal moves to the next. Only the
|
||||
leader accepts an agent, so a standby is skipped in the time it takes to
|
||||
be told so — which is what makes failover a reconnect rather than an
|
||||
edit to every node's configuration.
|
||||
|
||||
### `servers`
|
||||
|
||||
`[]string`
|
||||
|
||||
### `hostname`
|
||||
|
||||
`string`
|
||||
|
||||
Hostname defaults to the machine's.
|
||||
|
||||
### `mgmt_addr`
|
||||
|
||||
`string`
|
||||
|
||||
MgmtAddr is the address engines are reached on. It defaults to this
|
||||
machine's address on the route to the control plane, which is the one
|
||||
the control plane and the router can reach.
|
||||
|
||||
### `labels`
|
||||
|
||||
`map[string]string`
|
||||
|
||||
Labels are free-form facts about a node for a profile's node_selector.
|
||||
Nothing needs them: memory, GPUs, engines and disk are measured, and a
|
||||
label restating one of those goes stale the day the machine changes.
|
||||
|
||||
### `mgmt_interface`
|
||||
|
||||
`string`
|
||||
|
||||
MgmtInterface is the ethernet interface NCCL bootstraps over. It
|
||||
defaults to the interface holding MgmtAddr, then eth0.
|
||||
|
||||
### `fabrics`
|
||||
|
||||
`[]inventory.FabricAttachment`
|
||||
|
||||
Fabrics labels this node's HCAs. It is explicit on purpose: OpenSM's
|
||||
default subnet prefix is the same on every fabric, so nothing can be
|
||||
inferred from the wire (plan §5.2).
|
||||
|
||||
### `heartbeat_interval`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
### `reconnect_base`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
ReconnectBase is the first reconnect delay; it backs off from there.
|
||||
|
||||
### `reconnect_max`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
### `adopt_ready_timeout`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
AdoptReadyTimeout bounds how long an adopted engine is given to answer a
|
||||
health check before the agent stops waiting on it.
|
||||
|
||||
Shorter than a startup timeout on purpose: this engine is already
|
||||
running, so it is not loading a model, it is either serving or it is not.
|
||||
|
||||
### `tls`
|
||||
|
||||
`tlsconf.Config`
|
||||
|
||||
TLS authenticates both ends of the control-plane stream. Leaving it unset
|
||||
keeps the plaintext behaviour, which only belongs on a trusted network.
|
||||
|
||||
Takes a [tlsconf.Config](#tlsconfconfig) block.
|
||||
|
||||
### `model_dirs`
|
||||
|
||||
`[]string`
|
||||
|
||||
ModelDirs are the directories this node keeps model weights in, beyond
|
||||
WeightsCache, which is always looked in. Storage differs at every installation,
|
||||
so llmgw observes it rather than owning it: a Lustre mount, an image
|
||||
exported over the fabric, local NVMe and a copy made by hand all look
|
||||
identical from here, and placement only needs to know whether the file
|
||||
is present.
|
||||
|
||||
### `engines_dir`
|
||||
|
||||
`string`
|
||||
|
||||
EnginesDir is where the agent installs engines, one directory per
|
||||
build. Defaults to /opt/llmgw/engines.
|
||||
|
||||
### `weights_cache`
|
||||
|
||||
`string`
|
||||
|
||||
WeightsCache is where a remote source is downloaded to. Defaults to the
|
||||
first entry of ModelDirs, because a node that says where its models live
|
||||
has already answered this question, and otherwise to
|
||||
/var/lib/llmgw-weights.
|
||||
|
||||
Fetching is the simple arrangement: every node keeps its own copy. The
|
||||
exotic ones need no code — weights on a shared filer or an image exported
|
||||
over the fabric are simply present, and present means nothing is fetched.
|
||||
|
||||
### `discovery`
|
||||
|
||||
`discovery.Options`
|
||||
|
||||
Takes a [Options](#options) block.
|
||||
|
||||
### `engines`
|
||||
|
||||
`engines.Config`
|
||||
|
||||
Takes a [engines.Config](#enginesconfig) block.
|
||||
|
||||
### `supervisor`
|
||||
|
||||
`supervisor.Config`
|
||||
|
||||
Takes a [supervisor.Config](#supervisorconfig) block.
|
||||
|
||||
## config.Band
|
||||
|
||||
### `name`
|
||||
|
||||
`string`
|
||||
|
||||
### `priority`
|
||||
|
||||
`int`
|
||||
|
||||
### `saturation_ceiling`
|
||||
|
||||
`float64`
|
||||
|
||||
## config.Price
|
||||
|
||||
### `prompt_per_1k`
|
||||
|
||||
`int64`
|
||||
|
||||
### `completion_per_1k`
|
||||
|
||||
`int64`
|
||||
|
||||
## engines.Config
|
||||
|
||||
### `disabled`
|
||||
|
||||
`[]string`
|
||||
|
||||
Disabled are engines this node never installs or advertises, whatever
|
||||
the control plane asks: vLLM on a node of cards no build of it runs on,
|
||||
that is meant for llama.cpp alone.
|
||||
|
||||
### `vllm`
|
||||
|
||||
`VLLMConfig`
|
||||
|
||||
Takes a [VLLMConfig](#vllmconfig) block.
|
||||
|
||||
### `sglang`
|
||||
|
||||
`SGLangConfig`
|
||||
|
||||
Takes a [SGLangConfig](#sglangconfig) block.
|
||||
|
||||
### `llamacpp`
|
||||
|
||||
`LlamaCppConfig`
|
||||
|
||||
Takes a [LlamaCppConfig](#llamacppconfig) block.
|
||||
|
||||
### `sim`
|
||||
|
||||
`SimConfig`
|
||||
|
||||
Takes a [SimConfig](#simconfig) block.
|
||||
|
||||
## supervisor.Config
|
||||
|
||||
### `work_dir`
|
||||
|
||||
`string`
|
||||
|
||||
WorkDir holds pid files and per-shard scratch space.
|
||||
|
||||
### `log_lines`
|
||||
|
||||
`int`
|
||||
|
||||
LogLines is how many lines of engine output to retain per shard.
|
||||
|
||||
### `stop_timeout`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
StopTimeout is how long a process gets to exit after SIGTERM before it is
|
||||
killed. Engines need time to free GPU memory cleanly.
|
||||
|
||||
### `health_interval`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
HealthInterval is how often a starting shard is polled.
|
||||
|
||||
### `rendezvous_timeout`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
RendezvousTimeout bounds the wait for a multi-node rendezvous point to
|
||||
start listening.
|
||||
|
||||
### `alive_grace`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
AliveGrace is how long a non-serving rank must stay up before it counts
|
||||
as ready. There is no external signal for a worker, so staying alive is
|
||||
the only evidence available.
|
||||
|
||||
## tlsconf.Config
|
||||
|
||||
### `ca`
|
||||
|
||||
`string`
|
||||
|
||||
CA is the bundle used to verify the other side. In a real deployment this
|
||||
is whichever authority issued the fleet's certificates.
|
||||
|
||||
### `cert`
|
||||
|
||||
`string`
|
||||
|
||||
Cert and Key are this component's own identity.
|
||||
|
||||
### `key`
|
||||
|
||||
`string`
|
||||
|
||||
### `insecure`
|
||||
|
||||
`bool`
|
||||
|
||||
Insecure disables TLS entirely. It exists for local runs against
|
||||
sim-engines; anything using it must stay on a trusted network.
|
||||
|
||||
Reference in new issue
Block a user