Ilker ManapandClaude Opus 5.5 d2c27e2c76 Slurm: slurmd started as its unit expects, and slurmd's own stepd not a job ...

Found on the PoC (Ubuntu 24.04, Slurm 23.11.4): the packaged unit is
Type=notify, so slurmd needs --systemd or systemd times it out; and slurmd
keeps a 'slurmstepd infinity' for its cgroup v2 scope, which was counted as
a job and kept the node from llmgw.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-11 13:11:41 +01:00

..

discovery

How fast a model answers on the CPU, before it is served

2026-11-03 08:52:15 +01:00

engines

FreeToken, an engine for models larger than the card

2026-10-31 22:10:05 +01:00

provision

FreeToken, an engine for models larger than the card

2026-10-31 22:10:05 +01:00

slurmnode

Slurm: slurmd started as its unit expects, and slurmd's own stepd not a job

2026-11-11 13:11:41 +01:00

supervisor

FreeToken, an engine for models larger than the card

2026-10-31 22:10:05 +01:00

train

Trained adapters published, private to their owners like the knowledge bases they come from

2026-10-08 21:30:50 +02:00

weights

The weight sweep names a set as its fetch did

2026-11-08 14:01:27 +01:00

agent_test.go

A new stream is told the node's files again

2026-11-08 22:14:52 +01:00

agent.go

Slurm beside llmgw, P2: the agent keeps its node's part

2026-11-11 12:25:41 +01:00

bindaddr_test.go

Have engines listen on the management address, and take SGLang's key off its command line

2026-10-04 10:36:42 +02:00

config.go

The nodes' agent settings kept with the cluster's, agent.yaml down to what an agent needs to start

2026-10-08 18:06:36 +02:00

controlplanes_test.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

controlplanes.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

disabled_test.go

Decide engines per node, and let a node join without one it cannot run

2026-10-01 12:07:25 +02:00

fabrics.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

failover_test.go

Two control planes: a failover in seconds, and the console to set one up

2026-10-05 02:17:51 +02:00

firewall_test.go

The firewall turns off and on with the cluster's settings; llmgw wipe

2026-10-06 08:00:06 +02:00

firewall.go

The firewall turns off and on with the cluster's settings; llmgw wipe

2026-10-06 08:00:06 +02:00

gpucheck_test.go

Strata on cuda01 end to end: its engine is the shard's, its metrics read

2026-10-29 15:48:15 +01:00

gpucheck.go

Strata on cuda01 end to end: its engine is the shard's, its metrics read

2026-10-29 15:48:15 +01:00

kv_test.go

Precise KV-index routing: vLLM KV cache events through the agent, routed by leading blocks held

2026-10-05 01:21:11 +02:00

kv.go

Precise KV-index routing: vLLM KV cache events through the agent, routed by leading blocks held

2026-10-05 01:21:11 +02:00

logring_test.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logring.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logs.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

main_test.go

How fast a model answers on the CPU, before it is served

2026-11-03 08:52:15 +01:00

mig_test.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

mtls_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

provision.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

removeweights_test.go

Deleting unused model files says what went, and sets go whole

2026-11-03 10:29:16 +01:00

selfdescribe_test.go

Install a node's engines on the node, instead of trusting what is there

2026-09-28 10:59:59 +02:00

servers_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

settings_test.go

The nodes' agent settings kept with the cluster's, agent.yaml down to what an agent needs to start

2026-10-08 18:06:36 +02:00

settings.go

The nodes' agent settings kept with the cluster's, agent.yaml down to what an agent needs to start

2026-10-08 18:06:36 +02:00

shutdown_test.go

Fix an agent that could neither explain itself nor stop

2026-09-16 08:03:21 +02:00

slurm.go

Slurm beside llmgw, P2: the agent keeps its node's part

2026-11-11 12:25:41 +01:00

trace_test.go

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

trainjob.go

LoRA adapters trained on the nodes: llmgw ctl train

2026-10-08 20:25:57 +02:00

upgrade_test.go

Install only releases signed with the key built in; fetch a node's release on the control plane

2026-10-04 09:48:03 +02:00

upgrade.go

Cluster upgrades: nodes told together with progress said, done when back on the version, the download kept past a broken stream

2026-10-30 11:14:02 +01:00

watchexits_test.go

An adopted engine that turns ready after registration is reported

2026-10-07 19:43:13 +02:00