Ilker ManapandClaude Opus 5.5 ddb0472f9b A hardened install by default: baseline guardrails with Llama Guard 3 1B judging on a CPU, keys at most 90 days ...

server init (and the setup screens) write guard.default [baseline] —
secrets refused, cards masked, injection recorded, the judge refusing
S1-S4, S7, S9-S12 in prompts and answers, fail open after 5s — fetch the
judge into the mirror and run it on a node's CPU. --no-guard-model leaves
it out. The closing text names what init cannot do: TLS on the client
port and backup recipients.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-04 17:45:31 +02:00

..

admintoken_test.go

Guard the admin API and pprof with a token only root and the server can read

2026-10-04 10:02:44 +02:00

admintoken.go

Guard the admin API and pprof with a token only root and the server can read

2026-10-04 10:02:44 +02:00

agent.go

Add llmgw doctor: what a node's GPUs, NVLink and fabric need, checked

2026-09-29 03:51:09 +02:00

audit.go

Audit log: every change through the admin API and the administration pages, with ctl audit

2026-10-04 16:25:56 +02:00

backup_test.go

Encrypt backups to backup_recipients with age

2026-10-04 10:38:47 +02:00

backup.go

Encrypt backups to backup_recipients with age

2026-10-04 10:38:47 +02:00

bench.go

Give every engine a key only the router holds

2026-09-30 00:38:29 +02:00

capacity.go

Keep what a benchmark found out, instead of leaving it in a terminal

2026-09-27 11:51:58 +02:00

cert.go

Add a private CA and mutual TLS for the agent stream

2026-09-16 07:28:56 +02:00

ctl_fabrictest.go

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

ctl_logs.go

Show a node's logs on the admin page

2026-09-28 12:27:47 +02:00

ctl_request.go

Show guardrail refusals and stopped answers on the chat page, and the verdict in ctl request

2026-10-04 15:13:15 +02:00

ctl_restart.go

Restart in place at once when only the old replica is in the way

2026-10-01 12:11:37 +02:00

ctl_status_test.go

Draw the console's overview in its panel, not over the screen

2026-10-03 23:09:40 +02:00

ctl_upgrade_test.go

Upgrade the cluster with one command, over the agents' own streams

2026-09-30 02:54:36 +02:00

ctl_upgrade.go

Release v0.10.5

2026-09-30 22:26:19 +02:00

ctl.go

Notifications: webhooks for a parked model, a lost node, a spent budget and new weights; Alertmanager receiver templates

2026-10-04 16:58:11 +02:00

ctlweights.go

Carry a download's progress to where somebody is looking at it

2026-09-27 07:49:08 +02:00

dispatcherref_test.go

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

doctor.go

Fail a node only for the fabrics it declares

2026-10-01 12:13:18 +02:00

enginebuild.go

Choose each engine's build from the node's hardware, for every GPU generation

2026-10-01 14:35:58 +02:00

enginecheck_test.go

Ship binaries with releases, and ask engines whether our flags still exist

2026-09-16 16:44:29 +02:00

enginecheck.go

Do not call a GPU shard ready while it computes on the CPU

2026-10-01 11:54:39 +02:00

filter_test.go

Let ctl ask a question instead of printing the whole fleet

2026-09-27 07:30:51 +02:00

filter.go

Let ctl ask a question instead of printing the whole fleet

2026-09-27 07:30:51 +02:00

guard.go

Attach guard policies to scopes: store, admin API and ctl guard; run the gate when server.yaml defines policies

2026-10-04 12:34:47 +02:00

join.go

Let a machine join a setup by code, dialling out, with nothing logging in

2026-10-03 21:49:15 +02:00

keys_lifecycle_test.go

Key lifecycle: lifetime limits by scope, rotation with overlap, kinds and expiry in the listing

2026-10-04 16:45:05 +02:00

keys.go

Key lifecycle: lifetime limits by scope, rotation with overlap, kinds and expiry in the listing

2026-10-04 16:45:05 +02:00

memory.go

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

mirror_gate_test.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

mirror_test.go

Hide the mirror's bookkeeping, bound GGUF array nesting, and forget old serve jobs and downloads

2026-10-04 10:56:16 +02:00

mirror.go

Hide the mirror's bookkeeping, bound GGUF array nesting, and forget old serve jobs and downloads

2026-10-04 10:56:16 +02:00

mirrorinit.go

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

model_serve.go

Serve a judge model in one command: ctl model serve --guard-format

2026-10-04 15:27:35 +02:00

model_update.go

Serve and update models in the background from the console, and follow them under Jobs

2026-10-04 01:27:02 +02:00

model.go

Trace weights fetched before origins were kept, and let an origin be given by hand

2026-10-04 00:24:41 +02:00

modelplan.go

Plan a repository's files against the fleet, and serve the one that suits it the way it fits

2026-10-04 01:03:48 +02:00

movestore.go

Move a store to another one without reissuing every key

2026-09-25 16:28:38 +02:00

node.go

gofmt what the security work left unformatted

2026-10-04 12:22:51 +02:00

notify.go

Notifications: webhooks for a parked model, a lost node, a spent budget and new weights; Alertmanager receiver templates

2026-10-04 16:58:11 +02:00

org_test.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

org.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

quota.go

Set capacity quotas, class, owner and reservation from the admin pages

2026-09-30 22:40:45 +02:00

release.go

Sign releases, and install only signed ones once a key is trusted

2026-09-30 23:03:48 +02:00

resolve.go

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

root.go

The manual in the binary: llmgw docs, and Help in the console

2026-10-04 00:19:50 +02:00

selfupgrade.go

Release v0.10.5

2026-09-30 22:26:19 +02:00

servable_test.go

Refuse weights the nodes' llama.cpp cannot load, before fetching them

2026-09-28 20:44:36 +02:00

server_agent_test.go

Take agent_tls.insecure as consent to an agent port without TLS too

2026-10-04 10:11:40 +02:00

server.go

Notifications: webhooks for a parked model, a lost node, a spent budget and new weights; Alertmanager receiver templates

2026-10-04 16:58:11 +02:00

serveradd.go

Put etcd and Patroni's API on TLS, and move a running cluster there in maintenance mode

2026-10-04 12:07:17 +02:00

serverinit_cluster_test.go

A hardened install by default: baseline guardrails with Llama Guard 3 1B judging on a CPU, keys at most 90 days

2026-10-04 17:45:31 +02:00

serverinit_cluster.go

A hardened install by default: baseline guardrails with Llama Guard 3 1B judging on a CPU, keys at most 90 days

2026-10-04 17:45:31 +02:00

serverinit_firewall.go

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

serverinit_patroni.go

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

serverinit_postgres_test.go

Find the PostgreSQL a machine has, rather than assume its names

2026-09-28 14:47:55 +02:00

serverinit_postgres.go

Give the secrets directory its mode when init hands it to root, so the service can still read the store's address

2026-10-04 11:39:49 +02:00

serverinit_test.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

serverinit.go

A hardened install by default: baseline guardrails with Llama Guard 3 1B judging on a CPU, keys at most 90 days

2026-10-04 17:45:31 +02:00

simengine.go

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

sourcenote_test.go

Say when a replica is running an edited profile, and check a source from the web too

2026-09-27 22:42:26 +02:00

sourcenote.go

Say when a replica is running an edited profile, and check a source from the web too

2026-09-27 22:42:26 +02:00

status_test.go

Make the planned entry use an engine that can serve the precision

2026-09-17 07:48:20 +02:00

status.go

Draw the console's overview in its panel, not over the screen

2026-10-03 23:09:40 +02:00

storeflag_test.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

storeflag.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

threads.go

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

toolcheck_test.go

Stop tool-check blaming the engine for what the model did

2026-09-18 08:31:09 +02:00

toolcheck.go

Stop tool-check blaming the engine for what the model did

2026-09-18 08:31:09 +02:00

tui_actions_test.go

Console: rotate a key, cap key lifetimes, test the webhooks; README, onboarding and console docs caught up

2026-10-04 17:28:24 +02:00

tui_actions.go

A btop-like monitor in the console, from Prometheus; node exporters discovered and installed

2026-10-04 01:51:05 +02:00

tui_audit.go

Usage export as CSV: by period and by place, person, key and model, from the rollups

2026-10-04 16:49:04 +02:00

tui_chart.go

Place chart points by their time, so a window's samples fill the chart's width

2026-10-04 08:55:19 +02:00

tui_console.go

Console: rotate a key, cap key lifetimes, test the webhooks; README, onboarding and console docs caught up

2026-10-04 17:28:24 +02:00

tui_docs.go

Docs: one way in — quick-install starts at the setup screens, quickstart becomes development, install.md no longer says engines are yours to install

2026-10-04 17:32:54 +02:00

tui_frame.go

Show the version top right on every screen

2026-10-04 01:18:45 +02:00

tui_hf.go

Serve and update models in the background from the console, and follow them under Jobs

2026-10-04 01:27:02 +02:00

tui_home.go

Watch the cluster and edit every setting from the console

2026-10-03 22:54:09 +02:00

tui_init_test.go

A hardened install by default: baseline guardrails with Llama Guard 3 1B judging on a CPU, keys at most 90 days

2026-10-04 17:45:31 +02:00

tui_init.go

A hardened install by default: baseline guardrails with Llama Guard 3 1B judging on a CPU, keys at most 90 days

2026-10-04 17:45:31 +02:00

tui_jobs.go

Serve and update models in the background from the console, and follow them under Jobs

2026-10-04 01:27:02 +02:00

tui_mirror.go

Serve vision models with their projector and original weights on vLLM; group the mirror by version

2026-10-04 00:42:59 +02:00

tui_monitor.go

Console: rotate a key, cap key lifetimes, test the webhooks; README, onboarding and console docs caught up

2026-10-04 17:28:24 +02:00

tui_node_test.go

Let server init ask for what it needs, and node add take several nodes

2026-09-29 21:54:18 +02:00

tui_node.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

tui_people.go

Console: rotate a key, cap key lifetimes, test the webhooks; README, onboarding and console docs caught up

2026-10-04 17:28:24 +02:00

tui_setup_test.go

Watch the cluster and edit every setting from the console

2026-10-03 22:54:09 +02:00

tui_setup.go

Expire join codes on the setup's side, bind the join port to its address, trust the peer address

2026-10-04 10:16:53 +02:00

tui_widgets.go

Open setup screens or a console when llmgw runs bare in a terminal

2026-10-03 21:33:59 +02:00

usage.go

Usage export as CSV: by period and by place, person, key and model, from the rollups

2026-10-04 16:49:04 +02:00

users.go

Staff roles (viewer, operator, billing) and the console's Audit view

2026-10-04 16:30:56 +02:00