A node given a role takes only what asks for it
CI / test (push) Successful in 5m24s

The judges' machine was selected by the judge's profile, but any other
model could still be placed beside it. A node labelled llmgw.role now
takes only profiles whose selector asks for that role.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
Ilker ManapandClaude Opus 5.5 committed 2026-10-19 17:52:30 +02:00
1 parent 51ca09287f
commit 34764f5ef0
4 files changed
+31 -2

No files matched your search

+11
View File
@@ -548,6 +548,10 @@ func hasWeights(source string, n inventory.Node) (present, known bool) {
// It returns the label rather than a bare false so the rejection can name it:
// "does not carry ram=32g" is a placement failure someone can act on, and
// "no candidates were considered" is not.
// RoleLabel gives a node a role, such as judge: it then takes only profiles
// whose node selector asks for that role.
const RoleLabel = "llmgw.role"
func unmatchedLabel(selector, labels map[string]string) (string, bool) {
for k, want := range selector {
if got, ok := labels[k]; !ok || got != want {
@@ -602,6 +606,13 @@ func (s *Scheduler) eligibleNodes(p Profile, fabric string, avoid []string, reje
reject("does not carry " + miss)
continue
}
// A node given a role is kept for what asks for it: the judges'
// machine runs the judges alone, so nothing beside them takes the
// cores a judgment waits on.
if role, ok := n.Labels[RoleLabel]; ok && p.NodeSelector[RoleLabel] != role {
reject("kept for " + RoleLabel + "=" + role)
continue
}
// The engine has to be installed here. The field has been on this
// struct since placement was written and was never read, so a node
// with no vLLM was as good a candidate as one with it: the replica was