Ilker ManapandClaude Opus 5.5 ac24e204a6 Add capacity classes and preempt lower ones to place a model ...

A model's class (critical, standard, opportunistic; unset follows its
scaling) decides what may be stopped to make room for it: a lower class
for a higher, and within a class only what another grew into under load,
for a model below its minimum. Victims are tried on a copy of the
inventory and stopped only if they make the room. Preempted replicas are
drained with a short grace and their model is held back until the room is
used. ctl model resources and class move under ctl model.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-09-30 18:02:59 +02:00

..

choosing-models.md

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

data.md

Answer the two questions asked before a gateway is allowed near anything

2026-09-27 08:16:08 +02:00

fabrics.md

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

install.md

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

node-onboarding.md

Add a node with one command: llmgw node add, with a terminal screen

2026-09-29 19:33:47 +02:00

onboarding.md

Document what changed since v0.9.2, and fabrics for the sites that have them

2026-09-29 10:14:58 +02:00

quick-install.md

Put the mirror on its own machine in two commands

2026-09-29 22:17:24 +02:00

quickstart.md

Add a quick install guide: six steps from empty servers to a model

2026-09-29 18:13:05 +02:00

reference.md

Add capacity classes and preempt lower ones to place a model

2026-09-30 18:02:59 +02:00