Ilker ManapandClaude Opus 5.5 40e9fd2ab1 Federation: another llmgw cluster as a provider, its models as PEER/MODEL ...

ctl federation add/list/remove/sync keeps peers in the store (migration
0029); their /v1/models are offered here as external models named
PEER/MODEL and kept in step, a model still named by a fallback kept
withdrawn. Peers are checked at /ready, timed, and taken out of routing
while down. Requests to a peer carry x-llmgw-hop and are refused (508) when
they come back to a cluster they passed through; residency and no_store
keep requests off peers; X-Request-Id and, with --send-tags, attribution
tags go along. ctl model fallbacks sets overflow to a peer. Console view,
metrics, admin API routes and docs.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-05 01:21:30 +02:00

..

migrations

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

answercache_test.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

answercache.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

audit_test.go

Staff roles (viewer, operator, billing) and the console's Audit view

2026-10-04 16:30:56 +02:00

audit.go

Audit log: every change through the admin API and the administration pages, with ctl audit

2026-10-04 16:25:56 +02:00

batches_test.go

Secrets in Vault: env: and vault: references wherever a secret file is named, and the store's own secrets sealed under a master key — Vault transit or a local key

2026-10-04 23:21:44 +02:00

batches.go

Batches: OpenAI's Files and Batch APIs, served at the lowest priority under a store lease, each line a request of the key that made it

2026-10-04 21:00:01 +02:00

capacity_test.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

capacity.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

claims_test.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

claims.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

controlplanes.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

copy_test.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

copy.go

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

dialect_test.go

Name people and projects in usage reports, and total a usage legend

2026-09-28 22:37:21 +02:00

dialect.go

Name people and projects in usage reports, and total a usage legend

2026-09-28 22:37:21 +02:00

eval_test.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

eval.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

export_test.go

Usage export as CSV: by period and by place, person, key and model, from the rollups

2026-10-04 16:49:04 +02:00

export.go

gofmt the usage export

2026-10-04 16:49:14 +02:00

federation_test.go

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

federation.go

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

forget_test.go

Forgetting a person and keeping requests in the cluster: users forget, keys residency --in-cluster

2026-10-04 23:27:31 +02:00

forget.go

Forgetting a person and keeping requests in the cluster: users forget, keys residency --in-cluster

2026-10-04 23:27:31 +02:00

guard_test.go

The /admin/guard page, a Guardrails link, and the policies in force on the profile page

2026-10-04 15:15:38 +02:00

guard.go

The /admin/guard page, a Guardrails link, and the policies in force on the profile page

2026-10-04 15:15:38 +02:00

hierarchy_test.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

hierarchy.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

keys_test.go

Add the store: tenancy, keys and usage on SQLite

2026-09-16 08:37:40 +02:00

keys.go

Add the store: tenancy, keys and usage on SQLite

2026-09-16 08:37:40 +02:00

keyttl_test.go

Key lifecycle: lifetime limits by scope, rotation with overlap, kinds and expiry in the listing

2026-10-04 16:45:05 +02:00

keyttl.go

Key lifecycle: lifetime limits by scope, rotation with overlap, kinds and expiry in the listing

2026-10-04 16:45:05 +02:00

keyusage_test.go

Name people and projects in usage reports, and total a usage legend

2026-09-28 22:37:21 +02:00

latency_test.go

Show each team's first-token and latency percentiles, errors and refusals

2026-10-03 19:50:16 +02:00

latency.go

Show each team's first-token and latency percentiles, errors and refusals

2026-10-03 19:50:16 +02:00

leadership_test.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

leadership.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

limits_owner_test.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

memberships_test.go

Refuse the keys of an account that is not active

2026-10-04 10:15:32 +02:00

memberships.go

Refuse the keys of an account that is not active

2026-10-04 10:15:32 +02:00

memory_test.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

memory.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

migrate0010_test.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

migrate.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

models.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

nodeengines_test.go

Give each GPU node a vLLM build it can run, chosen on the cluster page

2026-10-01 12:39:14 +02:00

nodeengines.go

Give each GPU node a vLLM build it can run, chosen on the cluster page

2026-10-01 12:39:14 +02:00

open_test.go

Run the store on PostgreSQL, chosen by what the address looks like

2026-09-25 16:18:10 +02:00

open.go

Secrets in Vault: env: and vault: references wherever a secret file is named, and the store's own secrets sealed under a master key — Vault transit or a local key

2026-10-04 23:21:44 +02:00

pghosts.go

Set up a replicated store with server init --patroni, and watch it

2026-10-03 20:57:41 +02:00

postgres_memberships_test.go

Give an organization's managers a page of their own

2026-09-28 19:23:12 +02:00

postgres_test.go

Federation: another llmgw cluster as a provider, its models as PEER/MODEL

2026-10-05 01:21:30 +02:00

postgres.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

quotas_test.go

Guarantee and limit capacity per part of the tenancy tree

2026-09-30 18:15:38 +02:00

quotas.go

Guarantee and limit capacity per part of the tenancy tree

2026-09-30 18:15:38 +02:00

requestlog.go

Forgetting a person and keeping requests in the cluster: users forget, keys residency --in-cluster

2026-10-04 23:27:31 +02:00

revoked_test.go

Revoke a removed node's certificate, and require --api-client with a mirror's mutual TLS

2026-10-04 10:34:35 +02:00

revoked.go

Revoke a removed node's certificate, and require --api-client with a mirror's mutual TLS

2026-10-04 10:34:35 +02:00

rollup_test.go

Read usage from sums kept as it is written, not from every request

2026-10-03 19:43:10 +02:00

rollup.go

Show each team's first-token and latency percentiles, errors and refusals

2026-10-03 19:50:16 +02:00

seal.go

Onboard users with one-time links instead of pasted keys

2026-09-16 09:11:28 +02:00

secrets_test.go

Give every engine a key only the router holds

2026-09-30 00:38:29 +02:00

secrets.go

Secrets in Vault: env: and vault: references wherever a secret file is named, and the store's own secrets sealed under a master key — Vault transit or a local key

2026-10-04 23:21:44 +02:00

selfusage_test.go

Show a person their own use and what is left of their budgets

2026-09-28 22:51:13 +02:00

selfusage.go

Read usage from sums kept as it is written, not from every request

2026-10-03 19:43:10 +02:00

sessions_test.go

End a session unused for a day, and purge dead sessions and claims hourly

2026-10-04 10:50:56 +02:00

sessions.go

Staff roles (viewer, operator, billing) and the console's Audit view

2026-10-04 16:30:56 +02:00

sqlite.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

store_test.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

store.go

Reusing answers: a response cache per project, exact match, opt-in with a TTL

2026-10-04 23:50:53 +02:00

tenancy_test.go

Let an admin build the tenancy tree, instead of sending them to a shell

2026-09-27 12:36:13 +02:00

tenancy.go

Put quotas somewhere they can be seen and changed

2026-09-27 14:44:13 +02:00

threads_test.go

Give projects somewhere to keep a conversation, off unless they ask

2026-09-18 11:05:34 +02:00

threads.go

Stop calling the PostgreSQL store SQLite, and stop guessing where it is

2026-09-27 12:20:40 +02:00

unique_test.go

Recognise a duplicate sign-up on PostgreSQL, and say what to do

2026-10-01 12:15:37 +02:00

usagescope_test.go

Show what a group spent, and fix the reports that never ran on PostgreSQL

2026-09-27 12:26:14 +02:00

usagescope.go

Read usage from sums kept as it is written, not from every request

2026-10-03 19:43:10 +02:00

usageseries_test.go

Show usage over time, per organization, team, project and person

2026-09-28 08:11:31 +02:00

usageseries.go

Show each team's first-token and latency percentiles, errors and refusals

2026-10-03 19:50:16 +02:00

users.go

Staff roles (viewer, operator, billing) and the console's Audit view

2026-10-04 16:30:56 +02:00