Ilker ManapandClaude Opus 5.5 ac24e204a6 Add capacity classes and preempt lower ones to place a model ...

A model's class (critical, standard, opportunistic; unset follows its
scaling) decides what may be stopped to make room for it: a lower class
for a higher, and within a class only what another grew into under load,
for a model below its minimum. Victims are tried on a copy of the
inventory and stopped only if they make the room. Preempted replicas are
drained with a short grace and their model is held back until the room is
used. ctl model resources and class move under ctl model.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-09-30 18:02:59 +02:00

..

actor_test.go

Reserve CPU cores and require memory for CPU models

2026-09-30 17:43:13 +02:00

api_test.go

Add capacity classes and preempt lower ones to place a model

2026-09-30 18:02:59 +02:00

api.go

Add capacity classes and preempt lower ones to place a model

2026-09-30 18:02:59 +02:00

fabrictest.go

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

logs.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

summary_test.go

Know where the weights are, without owning the storage

2026-09-17 08:21:16 +02:00

summary.go

Park a model that fails every time it starts, and say so everywhere

2026-09-30 01:21:57 +02:00

weights.go

Refuse a node with no room, and take back only what llmgw put there

2026-09-18 09:51:05 +02:00