2 Commits

Include renames

Author	SHA1	Message	Date
Ilker ManapandClaude Opus 5.5	e1cff0d4e3	A served model can be moved to more cards, or fewer ... llmgw ctl model gpus MODEL N [--profile P] [--in-place], POST /api/v1/models/{name}/gpus and the console's GPUs…: how many cards of one node each replica uses. Tensor parallel for vLLM, SGLang and TensorRT-LLM, held to the model's KV heads (modelplan.SplitsHeads, now one rule for the planner and this); the layers split for llama.cpp, its old --tensor-split dropped. Refused for a count no node has, for cards that would not hold the weights and the context, and for engines on one card. The replicas start again beside the old ones; with no room beside them the command says so, and --in-place stops each first. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-29 16:40:49 +01:00
Ilker ManapandClaude Opus 5.5	986981ac81	A served model's context can be changed, engine and memory with it ... ctl model context MODEL TOKENS [--slots N], POST /api/v1/models/{name}/context and the console's Context length…: the catalog, the engine's arguments and the KV memory change together, refused past the trained context or what the cards hold, then the replicas restart one by one. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>	2026-10-29 15:50:04 +01:00