Ilker ManapandClaude Opus 5.5 a583359ebf Agents started together measure their memory apart ...

Seven VMs on one host restarted at once read a third less each than any
gets alone. An agent now waits 10 s to 2 min, at random, before measuring,
and measures again every hour, keeping the best.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-28 09:56:02 +01:00

..

discovery

How fast a model would answer on a CPU, before it is fetched

2026-10-27 00:09:47 +01:00

engines

Weights that run code are refused

2026-10-25 23:17:22 +01:00

provision

A picture or 3D model is added by its name: llmgw ctl model add triposr

2026-10-13 10:21:28 +02:00

supervisor

An engine's output goes to a file, which an agent restart cannot break

2026-10-10 10:25:04 +02:00

train

Trained adapters published, private to their owners like the knowledge bases they come from

2026-10-08 21:30:50 +02:00

weights

Weights that run code are refused

2026-10-25 23:17:22 +01:00

agent_test.go

Weights that run code are refused

2026-10-25 23:17:22 +01:00

agent.go

Agents started together measure their memory apart

2026-10-28 09:56:02 +01:00

bindaddr_test.go

Have engines listen on the management address, and take SGLang's key off its command line

2026-10-04 10:36:42 +02:00

config.go

The nodes' agent settings kept with the cluster's, agent.yaml down to what an agent needs to start

2026-10-08 18:06:36 +02:00

controlplanes_test.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

controlplanes.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

disabled_test.go

Decide engines per node, and let a node join without one it cannot run

2026-10-01 12:07:25 +02:00

fabrics.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

failover_test.go

Two control planes: a failover in seconds, and the console to set one up

2026-10-05 02:17:51 +02:00

firewall_test.go

The firewall turns off and on with the cluster's settings; llmgw wipe

2026-10-06 08:00:06 +02:00

firewall.go

The firewall turns off and on with the cluster's settings; llmgw wipe

2026-10-06 08:00:06 +02:00

gpucheck_test.go

What a replica computes on comes from nvidia-smi; llama.cpp says its layers only at -lv 4

2026-10-07 14:04:08 +02:00

gpucheck.go

What a replica computes on comes from nvidia-smi; llama.cpp says its layers only at -lv 4

2026-10-07 14:04:08 +02:00

kv_test.go

Precise KV-index routing: vLLM KV cache events through the agent, routed by leading blocks held

2026-10-05 01:21:11 +02:00

kv.go

Precise KV-index routing: vLLM KV cache events through the agent, routed by leading blocks held

2026-10-05 01:21:11 +02:00

logring_test.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logring.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logs.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

main_test.go

Agents started together measure their memory apart

2026-10-28 09:56:02 +01:00

mig_test.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

mtls_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

provision.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

removeweights_test.go

Refuse a node with no room, and take back only what llmgw put there

2026-09-18 09:51:05 +02:00

selfdescribe_test.go

Install a node's engines on the node, instead of trusting what is there

2026-09-28 10:59:59 +02:00

servers_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

settings_test.go

The nodes' agent settings kept with the cluster's, agent.yaml down to what an agent needs to start

2026-10-08 18:06:36 +02:00

settings.go

The nodes' agent settings kept with the cluster's, agent.yaml down to what an agent needs to start

2026-10-08 18:06:36 +02:00

shutdown_test.go

Fix an agent that could neither explain itself nor stop

2026-09-16 08:03:21 +02:00

trace_test.go

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

trainjob.go

LoRA adapters trained on the nodes: llmgw ctl train

2026-10-08 20:25:57 +02:00

upgrade_test.go

Install only releases signed with the key built in; fetch a node's release on the control plane

2026-10-04 09:48:03 +02:00

upgrade.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

watchexits_test.go

An adopted engine that turns ready after registration is reported

2026-10-07 19:43:13 +02:00