Ilker ManapandClaude Opus 5.5 cbd5521f4f Place llama.cpp across several GPUs of a node with gpus_per_node ...

tp on a llama.cpp profile was a width nothing placed. gpus_per_node is
now the count: placement reserves that many cards on one node and the
engine splits layers across them. tp, pp and nodes are refused with
what to write instead.

Refs #2 (item 8).

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-01 11:56:34 +02:00

..

discovery

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

engines

Place llama.cpp across several GPUs of a node with gpus_per_node

2026-10-01 11:56:34 +02:00

provision

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

supervisor

Wait for what tests check instead of sleeping and hoping

2026-09-30 01:36:55 +02:00

weights

Serve a model made of several files

2026-09-27 21:07:26 +02:00

agent_test.go

Wait for what tests check instead of sleeping and hoping

2026-09-30 01:36:55 +02:00

agent.go

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

config.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

fabrics.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

failover_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

gpucheck_test.go

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

gpucheck.go

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

logring_test.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logring.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logs.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

mtls_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

provision.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

removeweights_test.go

Refuse a node with no room, and take back only what llmgw put there

2026-09-18 09:51:05 +02:00

selfdescribe_test.go

Install a node's engines on the node, instead of trusting what is there

2026-09-28 10:59:59 +02:00

servers_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

shutdown_test.go

Fix an agent that could neither explain itself nor stop

2026-09-16 08:03:21 +02:00

upgrade_test.go

Upgrade the cluster with one command, over the agents' own streams

2026-09-30 02:54:36 +02:00

upgrade.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00