Ilker ManapandClaude Opus 5.5 c5b34978f5 Guardrails in the console ...

The console never mentioned them. A Guardrails view shows each policy with
its mode, fail behaviour and checks, whether its judge models have replicas
ready, where policies are attached (attach and detach from it), and what
they did in a window. The admin API gains GET /api/v1/guard/events, and GET
/api/v1/guard says what each policy does.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-05 03:36:17 +02:00

..

admintoken_test.go

Guard the admin API and pprof with a token only root and the server can read

2026-10-04 10:02:44 +02:00

admintoken.go

Guard the admin API and pprof with a token only root and the server can read

2026-10-04 10:02:44 +02:00

agent.go

Merge C20 tracing beyond the router

2026-10-05 00:05:29 +02:00

answercache_test.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

answercache.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

audit.go

Audit log: every change through the admin API and the administration pages, with ctl audit

2026-10-04 16:25:56 +02:00

backup_test.go

Encrypt backups to backup_recipients with age

2026-10-04 10:38:47 +02:00

backup.go

server restore: an archive checked, dry-run, and put back — configuration with modes and owners, the store in SQLite or PostgreSQL; backup_copy_to copies archives off the machine

2026-10-04 23:09:59 +02:00

backupcopy.go

server restore: an archive checked, dry-run, and put back — configuration with modes and owners, the store in SQLite or PostgreSQL; backup_copy_to copies archives off the machine

2026-10-04 23:09:59 +02:00

bench_test.go

ctl bench reads a guarded engine's metrics with the engine's key, or says why it cannot

2026-10-05 00:20:25 +02:00

bench.go

ctl bench reads a guarded engine's metrics with the engine's key, or says why it cannot

2026-10-05 00:20:25 +02:00

bundle.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

capacity.go

Keep what a benchmark found out, instead of leaving it in a terminal

2026-09-27 11:51:58 +02:00

cert.go

Add a private CA and mutual TLS for the agent stream

2026-09-16 07:28:56 +02:00

controlplanes_test.go

The probe reads the floating address from its file each time

2026-10-05 02:56:23 +02:00

controlplanes.go

The probe reads the floating address from its file each time

2026-10-05 02:56:23 +02:00

ctl_eval_test.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

ctl_eval.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

ctl_fabrictest.go

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

ctl_logs.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

ctl_request.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

ctl_restart.go

Restart in place at once when only the old replica is in the way

2026-10-01 12:11:37 +02:00

ctl_status_test.go

Draw the console's overview in its panel, not over the screen

2026-10-03 23:09:40 +02:00

ctl_upgrade_test.go

ctl upgrade in waves, and the other control plane first

2026-10-05 02:43:33 +02:00

ctl_upgrade.go

ctl upgrade in waves, and the other control plane first

2026-10-05 02:43:33 +02:00

ctl.go

Merge C24 federation: another llmgw cluster as a provider

2026-10-05 01:29:35 +02:00

ctlweights.go

Carry a download's progress to where somebody is looking at it

2026-09-27 07:49:08 +02:00

dispatcherref_test.go

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

doctor.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

enginebuild.go

Choose each engine's build from the node's hardware, for every GPU generation

2026-10-01 14:35:58 +02:00

enginecheck_test.go

SGLang read in its own metric names, started serving them, and asked for its own help

2026-10-05 00:20:25 +02:00

enginecheck.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

facility_test.go

Facility-aware placement: racks, PDUs, holds and power caps

2026-10-05 01:17:49 +02:00

facility.go

Facility-aware placement: racks, PDUs, holds and power caps

2026-10-05 01:17:49 +02:00

federation.go

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

filter_test.go

Let ctl ask a question instead of printing the whole fleet

2026-09-27 07:30:51 +02:00

filter.go

Facility-aware placement: racks, PDUs, holds and power caps

2026-10-05 01:17:49 +02:00

guard.go

Attach guard policies to scopes: store, admin API and ctl guard; run the gate when server.yaml defines policies

2026-10-04 12:34:47 +02:00

join.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

keys_lifecycle_test.go

Key lifecycle: lifetime limits by scope, rotation with overlap, kinds and expiry in the listing

2026-10-04 16:45:05 +02:00

keys.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

leaderforward_test.go

A standby's admin API is the leader's

2026-10-05 02:27:11 +02:00

leaderforward.go

A standby's admin API is the leader's

2026-10-05 02:27:11 +02:00

memory.go

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

mig_test.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

mirror_gate_test.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

mirror_import_test.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

mirror_import.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

mirror_test.go

Hide the mirror's bookkeeping, bound GGUF array nesting, and forget old serve jobs and downloads

2026-10-04 10:56:16 +02:00

mirror.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

mirrorinit.go

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

model_canary.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

model_serve.go

Serve a judge model in one command: ctl model serve --guard-format

2026-10-04 15:27:35 +02:00

model_update.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

model.go

Merge C24 federation: another llmgw cluster as a provider

2026-10-05 01:29:35 +02:00

modelplan.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

movestore.go

Move a store to another one without reissuing every key

2026-09-25 16:28:38 +02:00

node.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

notify.go

Notifications: webhooks for a parked model, a lost node, a spent budget and new weights; Alertmanager receiver templates

2026-10-04 16:58:11 +02:00

org_test.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

org.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

quota.go

Set capacity quotas, class, owner and reservation from the admin pages

2026-09-30 22:40:45 +02:00

release.go

Sign releases, and install only signed ones once a key is trusted

2026-09-30 23:03:48 +02:00

requestlog.go

Forgetting a person and keeping requests in the cluster: users forget, keys residency --in-cluster

2026-10-04 23:27:31 +02:00

resolve.go

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

restore_test.go

server restore: an archive checked, dry-run, and put back — configuration with modes and owners, the store in SQLite or PostgreSQL; backup_copy_to copies archives off the machine

2026-10-04 23:09:59 +02:00

restore.go

server restore: an archive checked, dry-run, and put back — configuration with modes and owners, the store in SQLite or PostgreSQL; backup_copy_to copies archives off the machine

2026-10-04 23:09:59 +02:00

root.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

selfupgrade.go

Release v0.10.5

2026-09-30 22:26:19 +02:00

servable_test.go

Refuse weights the nodes' llama.cpp cannot load, before fetching them

2026-09-28 20:44:36 +02:00

server_agent_test.go

Take agent_tls.insecure as consent to an agent port without TLS too

2026-10-04 10:11:40 +02:00

server.go

A stopping control plane gives up the lease before it lets its agents go

2026-10-05 02:31:13 +02:00

serveradd.go

A standby's admin API is the leader's

2026-10-05 02:27:11 +02:00

serverinit_bundle_test.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

serverinit_bundle.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

serverinit_cluster_test.go

The baseline fails closed with two judges, and a judge not answering is a notification

2026-10-04 19:19:49 +02:00

serverinit_cluster.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

serverinit_firewall.go

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

serverinit_patroni.go

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

serverinit_postgres_test.go

Find the PostgreSQL a machine has, rather than assume its names

2026-09-28 14:47:55 +02:00

serverinit_postgres.go

Give the secrets directory its mode when init hands it to root, so the service can still read the store's address

2026-10-04 11:39:49 +02:00

serverinit_test.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

serverinit.go

A standby's admin API is the leader's

2026-10-05 02:27:11 +02:00

simengine.go

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

sourcenote_test.go

Say when a replica is running an edited profile, and check a source from the web too

2026-09-27 22:42:26 +02:00

sourcenote.go

Say when a replica is running an edited profile, and check a source from the web too

2026-09-27 22:42:26 +02:00

status_test.go

Make the planned entry use an engine that can serve the precision

2026-09-17 07:48:20 +02:00

status.go

Two control planes: a failover in seconds, and the console to set one up

2026-10-05 02:17:51 +02:00

storeflag_test.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

storeflag.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

threads.go

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

toolcheck_test.go

Stop tool-check blaming the engine for what the model did

2026-09-18 08:31:09 +02:00

toolcheck.go

Stop tool-check blaming the engine for what the model did

2026-09-18 08:31:09 +02:00

tui_actions_test.go

Canary on the console's model menu; docs

2026-10-04 20:33:59 +02:00

tui_actions.go

Facility-aware placement: racks, PDUs, holds and power caps

2026-10-05 01:17:49 +02:00

tui_audit.go

Usage export as CSV: by period and by place, person, key and model, from the rollups

2026-10-04 16:49:04 +02:00

tui_chart.go

Place chart points by their time, so a window's samples fill the chart's width

2026-10-04 08:55:19 +02:00

tui_console.go

Guardrails in the console

2026-10-05 03:36:17 +02:00

tui_docs.go

A docs portal at /docs and a client developer's guide

2026-10-04 23:46:42 +02:00

tui_federation_test.go

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

tui_federation.go

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

tui_frame.go

Show the version top right on every screen

2026-10-04 01:18:45 +02:00

tui_guard.go

Guardrails in the console

2026-10-05 03:36:17 +02:00

tui_hf.go

Serve and update models in the background from the console, and follow them under Jobs

2026-10-04 01:27:02 +02:00

tui_home.go

Watch the cluster and edit every setting from the console

2026-10-03 22:54:09 +02:00

tui_init_test.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

tui_init.go

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

tui_jobs.go

Serve and update models in the background from the console, and follow them under Jobs

2026-10-04 01:27:02 +02:00

tui_mirror.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

tui_monitor.go

Console: rotate a key, cap key lifetimes, test the webhooks; README, onboarding and console docs caught up

2026-10-04 17:28:24 +02:00

tui_node_test.go

Let server init ask for what it needs, and node add take several nodes

2026-09-29 21:54:18 +02:00

tui_node.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

tui_people.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

tui_quality_test.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

tui_quality.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

tui_setup_test.go

Guardrails in the console

2026-10-05 03:36:17 +02:00

tui_setup.go

Expire join codes on the setup's side, bind the join port to its address, trust the peer address

2026-10-04 10:16:53 +02:00

tui_widgets.go

Open setup screens or a console when llmgw runs bare in a terminal

2026-10-03 21:33:59 +02:00

usage.go

Usage export as CSV: by period and by place, person, key and model, from the rollups

2026-10-04 16:49:04 +02:00

users.go

Forgetting a person and keeping requests in the cluster: users forget, keys residency --in-cluster

2026-10-04 23:27:31 +02:00