Ilker Manap and Claude Opus 5.5
0730d23b77
ctl guard says where policies live now; E1 done on the PoC
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-05 18:34:00 +02:00
Ilker Manap and Claude Opus 5.5
6289b01ed6
The cluster's settings live in the store, and every change takes effect
...
Everything in server.yaml that is not one machine's own is now a versioned
document in the store (cluster_settings), the same on every control plane.
The first start against a store imports the file's cluster keys, with the
baseline guard policy when there is none; after that those keys in a file
are ignored, with a warning.
Each control plane polls the document's version and its own server.yaml's
hash. A change is validated and applied: guard live (Gate.Replace), anything
else by a graceful restart that systemd brings back, standbys first and the
leader 30s later. A version that does not load on a machine is not applied;
at start the newest one that loads is used, so a bad edit cannot keep every
control plane down.
llmgw ctl config show/get/set/unset/edit/history/rollback, the admin API
under /api/v1/settings, and the console's Settings screen, which layers the
store's document over the machine's file, write it. Commands beside the
control plane that read cluster keys (init, node add, server add, backup,
upgrade) read the layered configuration; init --bundle writes offline to
the store once it holds the settings.
A standby that becomes the leader re-reads models, engine choices and
facility holds from the store.
Retires appendGuardIfMissing: the import does it.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-05 15:25:23 +02:00
Ilker Manap and Claude Opus 5.5
803d1d5fb6
CHANGELOG and BACKLOG for the rest of C24 and the engine fixes; README
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-05 01:30:01 +02:00
Ilker Manap and Claude Opus 5.5
6689d721a9
BACKLOG: the font note is done
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-05 00:18:18 +02:00
Ilker Manap and Claude Opus 5.5
a13a519386
CHANGELOG and BACKLOG for C17-C23 and the first parts of C24; README lists the new docs
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-05 00:17:16 +02:00
Ilker Manap and Claude Opus 5.5
30f7f3474a
Forgetting a person and keeping requests in the cluster: users forget, keys residency --in-cluster
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 23:27:31 +02:00
Ilker Manap and Claude Opus 5.5
35657c1417
Secrets in Vault: env: and vault: references wherever a secret file is named, and the store's own secrets sealed under a master key — Vault transit or a local key
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 23:21:44 +02:00
Ilker Manap and Claude Opus 5.5
bce54f0941
Scaling by the clock: schedule windows with their own min and max, prewarm, control.timezone
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 23:16:56 +02:00
Ilker Manap and Claude Opus 5.5
5b92ae0277
Token-level timing and admission by SLO: TPOT, inter-token and tokens a second by model and tenant; a model past its SLO is saturated for the lower bands
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 23:13:18 +02:00
Ilker Manap and Claude Opus 5.5
10466416df
server restore: an archive checked, dry-run, and put back — configuration with modes and owners, the store in SQLite or PostgreSQL; backup_copy_to copies archives off the machine
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 23:09:59 +02:00
Ilker Manap and Claude Opus 5.5
e502996198
Anthropic's Messages API: /v1/messages translated to chat completions and back, streamed or not, with tools and images; keys in x-api-key
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 22:59:55 +02:00
Ilker Manap and Claude Opus 5.5
9136bc71c2
More of OpenAI's API: Responses structured output, images and previous_response_id; rerank, score and audio passed through; moderations by the judge
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 22:56:25 +02:00
Ilker Manap and Claude Opus 5.5
32ff1dbd6f
Requests kept and replayed: keys requests per project with retention and a share, ctl request --body and --replay
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 22:51:21 +02:00
Ilker Manap and Claude Opus 5.5
841ee21c12
Batches: OpenAI's Files and Batch APIs, served at the lowest priority under a store lease, each line a request of the key that made it
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 21:00:01 +02:00
Ilker Manap and Claude Opus 5.5
889be70b8f
Canary on the console's model menu; docs
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 20:33:59 +02:00
Ilker Manap and Claude Opus 5.5
29a7347df2
Requests can be tagged: metadata, x-llmgw-tags and the user field on the usage record, and counted by the tags router.tag_labels names
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 19:45:37 +02:00
Ilker Manap and Claude Opus 5.5
1b71c38f89
Notifications: webhooks for a parked model, a lost node, a spent budget and new weights; Alertmanager receiver templates
...
notify.webhooks sends signed JSON or Slack-compatible messages, queued,
retried, de-duplicated hourly; ctl notify test checks each webhook.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 16:58:11 +02:00
Ilker Manap and Claude Opus 5.5
57739d736a
Usage export as CSV: by period and by place, person, key and model, from the rollups
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 16:49:04 +02:00
Ilker Manap and Claude Opus 5.5
8866a1ea0f
Key lifecycle: lifetime limits by scope, rotation with overlap, kinds and expiry in the listing
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 16:45:05 +02:00
Ilker Manap and Claude Opus 5.5
14ea59d83f
Provisioning through SCIM 2.0: accounts and groups kept in step by the identity provider
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 16:40:15 +02:00
Ilker Manap and Claude Opus 5.5
b60cf45adf
Staff roles (viewer, operator, billing) and the console's Audit view
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 16:30:56 +02:00
Ilker Manap and Claude Opus 5.5
4df30fc175
Record section B's state after trying it on the PoC
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 15:40:18 +02:00
Ilker Manap and Claude Opus 5.5
d55472c00a
Guardrails in the console: attach and detach on a branch, where each applies from, and a column
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 15:18:42 +02:00
Ilker Manap and Claude Opus 5.5
43f6a585a6
A judge model on the cluster: role guard in the catalog, judge in a guard policy
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 15:09:31 +02:00
Ilker Manap and Claude Opus 5.5
dc788e5cda
Opt-in capability checks and structured-answer validation in guard policies
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 12:39:40 +02:00
Ilker Manap and Claude Opus 5.5
979aa44804
Hook a guard into the router: judge requests before dispatch and filter answers as they are relayed
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 12:20:24 +02:00
Ilker Manap and Claude Opus 5.5
eb10aee93b
Document TLS between the store's machines, and close section A of the backlog
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 12:12:35 +02:00
Ilker Manap and Claude Opus 5.5
855a34f0f7
Record the firewall as live on the PoC
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 11:52:28 +02:00
Ilker Manap and Claude Opus 5.5
dae7afbc17
Record what of section A is done and what is left
...
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
2026-10-04 11:05:10 +02:00
Ilker Manap and Claude Fable 5.1
e01107d525
Write down what the review of 2026-10-04 found to do: security first, then guardrails, then features
...
CI / test (push) Successful in 4m1s
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com >
2026-10-04 09:38:01 +02:00