Ilker ManapandClaude Opus 5.5 a1b1663e9d A btop-like monitor in the console, from Prometheus; node exporters discovered and installed ...

Monitor draws CPU, memory, GPUs, requests, tokens, latency, network and disk
as Braille charts over 5m/1h/24h/7d, then per node, card and model
sparklines; node and model pages have their own. History is read from
monitoring.prometheus through POST /api/v1/metrics/range, or without it
from what the console saw. The control plane serves the cluster's machines
for Prometheus http_sd at /prometheus/targets on its metrics port, and node
add installs prometheus-node-exporter.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-04 01:51:05 +02:00

..

actor_test.go

Reserve CPU cores and require memory for CPU models

2026-09-30 17:43:13 +02:00

adapters_test.go

Attach LoRA adapters from the command line

2026-10-01 07:30:13 +02:00

api_test.go

Attach LoRA adapters from the command line

2026-10-01 07:30:13 +02:00

api.go

A btop-like monitor in the console, from Prometheus; node exporters discovered and installed

2026-10-04 01:51:05 +02:00

fabrictest.go

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

logs.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

metrics.go

A btop-like monitor in the console, from Prometheus; node exporters discovered and installed

2026-10-04 01:51:05 +02:00

nodeengine_test.go

Give each GPU node a vLLM build it can run, chosen on the cluster page

2026-10-01 12:39:14 +02:00

promsd_test.go

A btop-like monitor in the console, from Prometheus; node exporters discovered and installed

2026-10-04 01:51:05 +02:00

promsd.go

A btop-like monitor in the console, from Prometheus; node exporters discovered and installed

2026-10-04 01:51:05 +02:00

quotas_test.go

Guarantee and limit capacity per part of the tenancy tree

2026-09-30 18:15:38 +02:00

quotas.go

Set capacity quotas, class, owner and reservation from the admin pages

2026-09-30 22:40:45 +02:00

summary_test.go

Know where the weights are, without owning the storage

2026-09-17 08:21:16 +02:00

summary.go

Set up a replicated store with server init --patroni, and watch it

2026-10-03 20:57:41 +02:00

target_test.go

Scale and place by what a replica was measured to serve

2026-09-30 18:21:08 +02:00

target.go

Set capacity quotas, class, owner and reservation from the admin pages

2026-09-30 22:40:45 +02:00

weights.go

Serve LoRA adapters on llama.cpp models, asked for by name

2026-09-30 23:40:47 +02:00