Ilker ManapandClaude Opus 5.5 057be16a92 Do not call a GPU shard ready while it computes on the CPU ...

llama.cpp whose CUDA backend cannot load runs on the CPU without an
error. The CUDA build is now asked for its devices when installed, a
shard on GPUs must hold memory on each before it is ready, and
engine-check reports the devices. Shards get CUDA_DEVICE_ORDER=PCI_BUS_ID
so CUDA numbers GPUs as placement does.

Refs #2 (item 2).

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-01 11:54:39 +02:00

..

discovery

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

engines

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

provision

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

supervisor

Wait for what tests check instead of sleeping and hoping

2026-09-30 01:36:55 +02:00

weights

Serve a model made of several files

2026-09-27 21:07:26 +02:00

agent_test.go

Wait for what tests check instead of sleeping and hoping

2026-09-30 01:36:55 +02:00

agent.go

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

config.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

fabrics.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

failover_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

gpucheck_test.go

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

gpucheck.go

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

logring_test.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logring.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logs.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

mtls_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

provision.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

removeweights_test.go

Refuse a node with no room, and take back only what llmgw put there

2026-09-18 09:51:05 +02:00

selfdescribe_test.go

Install a node's engines on the node, instead of trusting what is there

2026-09-28 10:59:59 +02:00

servers_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

shutdown_test.go

Fix an agent that could neither explain itself nor stop

2026-09-16 08:03:21 +02:00

upgrade_test.go

Upgrade the cluster with one command, over the agents' own streams

2026-09-30 02:54:36 +02:00

upgrade.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00