Ilker ManapandClaude Opus 5.5 8cc8d7139b SGLang read in its own metric names, started serving them, and asked for its own help ...

The router read SGLang replicas with vLLM's names, and SGLang was started
without --enable-metrics, so it served no /metrics: every scrape failed as
if unreachable and the replica was routed to blind. It now gets
--enable-metrics and a mapping of its own (sglang:num_running_reqs,
num_queue_reqs, token_usage, the token counters and num_requests_total, as
0.5.21 publishes them). engine-check asks python -m sglang.launch_server
--help instead of Python's own help, and SGLang is given --tp-size rather
than the --tp argparse only takes as an abbreviation.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-05 00:20:25 +02:00

..

discovery

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

engines

SGLang read in its own metric names, started serving them, and asked for its own help

2026-10-05 00:20:25 +02:00

provision

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

supervisor

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

weights

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

agent_test.go

Wait for what tests check instead of sleeping and hoping

2026-09-30 01:36:55 +02:00

agent.go

Merge C20 tracing beyond the router

2026-10-05 00:05:29 +02:00

bindaddr_test.go

Have engines listen on the management address, and take SGLang's key off its command line

2026-10-04 10:36:42 +02:00

config.go

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

controlplanes_test.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

controlplanes.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

disabled_test.go

Decide engines per node, and let a node join without one it cannot run

2026-10-01 12:07:25 +02:00

fabrics.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

failover_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

gpucheck_test.go

Judge a card shared with another process every heartbeat, not once

2026-10-03 18:46:23 +02:00

gpucheck.go

Judge a card shared with another process every heartbeat, not once

2026-10-03 18:46:23 +02:00

logring_test.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logring.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

logs.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

mig_test.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

mtls_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

provision.go

Give each GPU node a vLLM build it can run, chosen on the cluster page

2026-10-01 12:39:14 +02:00

removeweights_test.go

Refuse a node with no room, and take back only what llmgw put there

2026-09-18 09:51:05 +02:00

selfdescribe_test.go

Install a node's engines on the node, instead of trusting what is there

2026-09-28 10:59:59 +02:00

servers_test.go

Let an agent find the leader instead of being told one address

2026-09-25 19:30:06 +02:00

shutdown_test.go

Fix an agent that could neither explain itself nor stop

2026-09-16 08:03:21 +02:00

trace_test.go

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

upgrade_test.go

Install only releases signed with the key built in; fetch a node's release on the control plane

2026-10-04 09:48:03 +02:00

upgrade.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

watchexits_test.go

Report a ready engine dying from every connection, adopted ones included

2026-10-04 11:50:09 +02:00