A plan for a big model: experts spread, any number of nodes, memory said

A mixture-of-experts model on more than one card is served with vLLM's
--enable-expert-parallel; config.json's experts are read by any of their
names, and a model that also reads pictures is sized by its text_config.
Tensor parallelism past the KV heads is allowed when it is a multiple of
them (Qwen3-235B, four KV heads, runs on eight cards), which the plan
had refused. Several nodes are offered in any number, not only powers of
two. Each way says what it needs of a card, part by part, and of all its
cards; the serve form checks a context longer than planned still fits.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

docs/admin-api.openapi.json

@@ -10516,6 +10516,20 @@
           "bits_per_weight": {
             "type": "number",
             "description": "BitsPerWeight is the artifact's precision, 0 when unknown."
+          },
+          "weights_gb": {
+            "type": "number",
+            "description": "What NeedGB is made of, a card's share (or, on the CPU, the node's RAM): the weights, the context's KV cache, and the engine's own."
+          },
+          "context_gb": {
+            "type": "number"
+          },
+          "engine_gb": {
+            "type": "number"
+          },
+          "expert_parallel": {
+            "type": "boolean",
+            "description": "ExpertParallel spreads a mixture-of-experts model's experts over the cards, whole, rather than slicing each across them: vLLM's --enable-expert-parallel, for a model of experts on more than one card."
           }
         }
       },
@@ -10620,6 +10634,11 @@
           "context": {
             "type": "integer"
           },
+          "kv_bytes_per_token": {
+            "type": "integer",
+            "format": "int64",
+            "description": "KVBytesPerToken is one token of context, the whole model: what an option needs for another context is worked out from it. 0 is unknown."
+          },
           "gated": {
             "type": "boolean"
           },