Nodes show their engines' versions and GPUs' capability; a profile can ask for an engine version
NodeView carries engine_versions and compute_capabilities; ctl nodes shows llamacpp b10991 and 6000-24g (7.5). A profile's engine_version restricts it to nodes whose engine version starts with it, and explain-placement says which version a node has, or which engines it has when it lacks the one asked for. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
e4e15200d6
commit
619dd751ab
9 files changed
+158
-21
No files matched your search
@@ -5031,6 +5031,19 @@
|
||||
},
|
||||
"description": "Engines are the inference engines installed here, as the agent found them. Absent means the agent is older than the probe and said nothing, which is not the same as having none — placement treats it that way too, or a control plane upgrade would empty a fleet."
|
||||
},
|
||||
"engine_versions": {
|
||||
"type": "object",
|
||||
"additionalProperties": {
|
||||
"type": "string"
|
||||
},
|
||||
"description": "EngineVersions are the installed engines with their versions: llamacpp → b10991. ComputeCapabilities are its GPUs' CUDA compute capabilities, 7.0 for a V100, so an engine build's support can be read against them."
|
||||
},
|
||||
"compute_capabilities": {
|
||||
"type": "array",
|
||||
"items": {
|
||||
"type": "string"
|
||||
}
|
||||
},
|
||||
"provision": {
|
||||
"type": "array",
|
||||
"items": {
|
||||
@@ -6434,6 +6447,10 @@
|
||||
"engine": {
|
||||
"type": "string"
|
||||
},
|
||||
"engine_version": {
|
||||
"type": "string",
|
||||
"description": "EngineVersion restricts the profile to nodes whose installed engine's version starts with it: \"0.11\" takes vLLM 0.11.0 and 0.11.1, not 0.10.2. Empty takes whatever version the node has."
|
||||
},
|
||||
"gpu_class": {
|
||||
"type": "string"
|
||||
},
|
||||
|
||||
Reference in new issue
Block a user