Ilker Manap and Claude Opus 5.5
ac24e204a6
Add capacity classes and preempt lower ones to place a model
...
A model's class (critical, standard, opportunistic; unset follows its
scaling) decides what may be stopped to make room for it: a lower class
for a higher, and within a class only what another grew into under load,
for a model below its minimum. Victims are tried on a copy of the
inventory and stopped only if they make the room. Preempted replicas are
drained with a short grace and their model is held back until the room is
used. ctl model resources and class move under ctl model.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-09-30 18:02:59 +02:00
..
2026-09-29 03:51:09 +02:00
2026-09-30 02:25:07 +02:00
2026-09-30 02:25:07 +02:00
2026-09-30 00:38:29 +02:00
2026-09-27 11:51:58 +02:00
2026-09-16 07:28:56 +02:00
2026-09-29 21:29:23 +02:00
2026-09-28 12:27:47 +02:00
2026-09-30 02:36:45 +02:00
2026-09-30 01:21:57 +02:00
2026-09-30 01:14:12 +02:00
2026-09-30 02:54:36 +02:00
2026-09-30 02:54:36 +02:00
2026-09-30 18:02:59 +02:00
2026-09-27 07:49:08 +02:00
2026-09-29 21:29:23 +02:00
2026-09-29 13:15:54 +02:00
2026-09-16 16:44:29 +02:00
2026-09-16 16:52:11 +02:00
2026-09-27 07:30:51 +02:00
2026-09-27 07:30:51 +02:00
2026-09-28 19:03:46 +02:00
2026-09-28 16:26:39 +02:00
2026-09-30 04:00:35 +02:00
2026-09-27 22:42:26 +02:00
2026-09-30 04:00:35 +02:00
2026-09-29 22:17:24 +02:00
2026-09-30 17:43:13 +02:00
2026-09-30 18:02:59 +02:00
2026-09-17 07:48:20 +02:00
2026-09-25 16:28:38 +02:00
2026-09-29 21:54:18 +02:00
2026-09-28 19:03:46 +02:00
2026-09-28 19:03:46 +02:00
2026-09-28 16:26:39 +02:00
2026-09-29 19:33:47 +02:00
2026-09-28 20:44:36 +02:00
2026-09-30 04:00:35 +02:00
2026-09-29 22:17:24 +02:00
2026-09-29 22:17:24 +02:00
2026-09-28 14:47:55 +02:00
2026-09-28 14:47:55 +02:00
2026-09-28 19:03:46 +02:00
2026-09-29 22:17:24 +02:00
2026-09-16 12:28:36 +02:00
2026-09-27 22:42:26 +02:00
2026-09-27 22:42:26 +02:00
2026-09-17 07:48:20 +02:00
2026-09-30 01:21:57 +02:00
2026-09-27 12:20:40 +02:00
2026-09-27 12:20:40 +02:00
2026-09-28 16:26:39 +02:00
2026-09-18 08:31:09 +02:00
2026-09-18 08:31:09 +02:00
2026-09-29 22:17:24 +02:00
2026-09-30 04:00:35 +02:00
2026-09-29 21:54:18 +02:00
2026-09-29 22:37:28 +02:00
2026-09-29 22:37:28 +02:00
2026-09-27 12:26:14 +02:00
2026-09-28 19:23:12 +02:00