CI / test (push) Failing after 6m19s
A catalog entry meant for many sites cannot know their GPU class names:
the PoC has a Quadro RTX 6000, a customer an A100, another an L40S. A
profile may now say gpu: {min_compute_capability, min_memory_gb} in
place of gpu_class, and stands for every class in the cluster that meets
it, named <profile>@<class>, at its own priority; placement still sees
exact classes. ProfileByName and EngineProfile resolve such a name to
the profile on that class, so every caller that maps a replica back to
its profile works unchanged. A ComfyUI profile may carry its own
workflow, checkpoint and nodes, and with its own source an fp8 workflow
and weights go to cards with fp8 and fp16 ones to Turing.
A profile by need is left out of placement until the cluster's cards are
known: with no class it would have read as a CPU profile.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
17 lines
478 B
Go
17 lines
478 B
Go
package reconciler
|
|
|
|
import (
|
|
"gitea.mynodes.xyz/ilker/llmgw/internal/agent/discovery"
|
|
"gitea.mynodes.xyz/ilker/llmgw/internal/control/catalog"
|
|
)
|
|
|
|
// gpuKinds are the kinds of card the cluster's nodes have, for a profile that
|
|
// names its GPU by what it needs rather than by class to stand for.
|
|
func (r *Reconciler) gpuKinds() []catalog.GPUKind {
|
|
var gpus []discovery.GPU
|
|
for _, n := range r.inv.Nodes() {
|
|
gpus = append(gpus, n.GPUs...)
|
|
}
|
|
return catalog.GPUKinds(gpus)
|
|
}
|