-
v0.15.2
Stable
gitea-actions
released this
2026-10-29 16:58:02 +01:00 | 83 commits to main since this releaseA served model moved to more cards, or fewer, while it is served.
Upgrading.
- No migrations, and nothing changes until the command is used. The control
planes carry it; the nodes need nothing new.
Added
- A served model moved to more cards, or fewer.
llmgw ctl model gpus MODEL N [--profile P] [--in-place],POST /api/v1/models/{name}/gpus, and
GPUs… in the console's model menu. How many cards of one node each replica
uses: tensor parallel for vLLM, SGLang and TensorRT-LLM, checked against
the model's KV heads, and the layers split for llama.cpp. Refused for a
count no node has, or whose cards would not hold the model and its
context, with the figures; its replicas are then started again on it, one
by one, beside the old — or, with--in-placewhen there is no room
beside them, each stopped first.
Downloads
- No migrations, and nothing changes until the command is used. The control