Ilker ManapandClaude Opus 5.5 cbd5521f4f Place llama.cpp across several GPUs of a node with gpus_per_node ...

tp on a llama.cpp profile was a width nothing placed. gpus_per_node is
now the count: placement reserves that many cards on one node and the
engine splits layers across them. tp, pp and nodes are refused with
what to write instead.

Refs #2 (item 8).

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-01 11:56:34 +02:00

..

adminapi

Attach LoRA adapters from the command line

2026-10-01 07:30:13 +02:00

agentsvc

Serve LoRA adapters on llama.cpp models, asked for by name

2026-09-30 23:40:47 +02:00

catalog

Place llama.cpp across several GPUs of a node with gpus_per_node

2026-10-01 11:56:34 +02:00

fabrics

Watch each fabric's subnet managers, and keep a fabric one through a failover

2026-09-29 07:47:03 +02:00

fabrictest

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

fleetmetrics

Read nodes' heat and power: GPUs, CPUs, board inlet, RAPL

2026-09-30 19:49:08 +02:00

inventory

Read nodes' heat and power: GPUs, CPUs, board inlet, RAPL

2026-09-30 19:49:08 +02:00

modelserve

Reserve CPU cores and require memory for CPU models

2026-09-30 17:43:13 +02:00

modelsvc

Find LoRA adapters on Hugging Face and attach them from the mirror page

2026-10-01 07:19:08 +02:00

nvlink

Find multi-node NVLink domains, place across them, and show them as racks

2026-09-29 09:07:59 +02:00

placement

Reserve CPU cores and require memory for CPU models

2026-09-30 17:43:13 +02:00

quota

Guarantee and limit capacity per part of the tenancy tree

2026-09-30 18:15:38 +02:00

reconciler

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

topology

Map every InfiniBand fabric, draw it, and place replicas by it

2026-09-29 08:46:23 +02:00

control_test.go

Give every engine a key only the router holds

2026-09-30 00:38:29 +02:00

control.go

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

external_test.go

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

leadership.go

Stop a second control plane from placing work behind the first's back

2026-09-25 18:24:06 +02:00

quotas.go

Scale and place by what a replica was measured to serve

2026-09-30 18:21:08 +02:00