Ilker ManapandClaude Opus 5.5 b6a802c03b Map the fleet's GPUs, and name the cards held and idle ...

The cluster page draws every card coloured by utilisation, memory or
temperature, and lists replicas whose every card is under 5% busy.
llmgw_gpu_assigned says which replica, model and owner hold each card.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-01 15:54:58 +02:00

..

account

Close what a second security review found still open

2026-09-30 02:25:07 +02:00

accounting

Tell clients how much of their rate limit is left

2026-09-30 02:42:21 +02:00

agent

Sample GPU utilisation and memory every heartbeat, and chart them

2026-10-01 15:42:17 +02:00

auth

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

bench

Give every engine a key only the router holds

2026-09-30 00:38:29 +02:00

cli

Choose each engine's build from the node's hardware, for every GPU generation

2026-10-01 14:35:58 +02:00

config

Decide engines per node, and let a node join without one it cannot run

2026-10-01 12:07:25 +02:00

control

Map the fleet's GPUs, and name the cards held and idle

2026-10-01 15:54:58 +02:00

docgen

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

doctor

Choose each engine's build from the node's hardware, for every GPU generation

2026-10-01 14:35:58 +02:00

gguf

Format kind_live_test.go

2026-10-01 07:20:35 +02:00

hf

Mirror a many-file model whole, with its checksums, for vLLM

2026-10-01 12:21:04 +02:00

mirror

Mirror a many-file model whole, with its checksums, for vLLM

2026-10-01 12:21:04 +02:00

modelplan

Make the planned entry use an engine that can serve the precision

2026-09-17 07:48:20 +02:00

obs

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

onboard

Fail a node only for the fabrics it declares

2026-10-01 12:13:18 +02:00

promq

Show usage over time, per organization, team, project and person

2026-09-28 08:11:31 +02:00

release

Sign releases, and install only signed ones once a key is trusted

2026-09-30 23:03:48 +02:00

router

Give each GPU node a vLLM build it can run, chosen on the cluster page

2026-10-01 12:39:14 +02:00

sim

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

sourcecheck

Say when a replica is running an edited profile, and check a source from the web too

2026-09-27 22:42:26 +02:00

store

Give each GPU node a vLLM build it can run, chosen on the cluster page

2026-10-01 12:39:14 +02:00

tlsconf

Park a model that fails every time it starts, and say so everywhere

2026-09-30 01:21:57 +02:00

version

Switch the project language to English

2026-09-16 01:15:21 +02:00

web

Map the fleet's GPUs, and name the cards held and idle

2026-10-01 15:54:58 +02:00