llmgw

Count sign-in attempts per address and client, guard the sign-in form with a token, ration both forms per address

2026-10-04 10:26:29 +02:00

Notifications: webhooks for a parked model, a lost node, a spent budget and new weights; Alertmanager receiver templates

2026-10-04 16:58:11 +02:00

agent

Report a ready engine dying from every connection, adopted ones included

2026-10-04 11:50:09 +02:00

audit

Audit log: every change through the admin API and the administration pages, with ctl audit

2026-10-04 16:25:56 +02:00

auth

Anthropic's Messages API: /v1/messages translated to chat completions and back, streamed or not, with tools and images; keys in x-api-key

2026-10-04 22:59:55 +02:00

bench

Give every engine a key only the router holds

2026-09-30 00:38:29 +02:00

canary

Canary routing: a model's canary takes its share of requests, a session stays on one side, x-llmgw-variant pins one, and the two are compared

2026-10-04 19:56:16 +02:00

cli

Requests kept and replayed: keys requests per project with retention and a share, ctl request --body and --replay

2026-10-04 22:51:21 +02:00

clientip

Believe X-Forwarded-* only from router.trusted_proxies

2026-10-04 10:29:02 +02:00

config

Batches: OpenAI's Files and Batch APIs, served at the lowest priority under a store lease, each line a request of the key that made it

2026-10-04 21:00:01 +02:00

control

Requests kept and replayed: keys requests per project with retention and a share, ctl request --body and --replay

2026-10-04 22:51:21 +02:00

docgen

Batches: OpenAI's Files and Batch APIs, served at the lowest priority under a store lease, each line a request of the key that made it

2026-10-04 21:00:01 +02:00

doctor

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

firewall

Keep llmgw's internal ports to the cluster's networks with an nftables table of its own

2026-10-04 11:03:46 +02:00

gguf

Hide the mirror's bookkeeping, bound GGUF array nesting, and forget old serve jobs and downloads

2026-10-04 10:56:16 +02:00

guard

More of OpenAI's API: Responses structured output, images and previous_response_id; rerank, score and audio passed through; moderations by the judge

2026-10-04 22:56:25 +02:00

hf

Plan a repository's files against the fleet, and serve the one that suits it the way it fits

2026-10-04 01:03:48 +02:00

join

Bound idle time, header size and request reading on every listener, and connections on the client port

2026-10-04 10:21:15 +02:00

mirror

Hide the mirror's bookkeeping, bound GGUF array nesting, and forget old serve jobs and downloads

2026-10-04 10:56:16 +02:00

modelplan

Busy is not unfit: rank files by the hardware the cluster has, and let a model wait for its cards

2026-10-04 01:17:32 +02:00

notify

Canary of a model's newer weights: ctl model canary, promote and canaries, rolled back by itself when it serves worse

2026-10-04 20:31:26 +02:00

obs

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

onboard

Do not warn of a missing firewall during the node add that writes it

2026-10-04 11:58:18 +02:00

pgha

Make a member's own access rules hostssl when the cluster keeps them there

2026-10-04 12:11:05 +02:00

preflight

Open setup screens or a console when llmgw runs bare in a terminal

2026-10-03 21:33:59 +02:00

promq

Show usage over time, per organization, team, project and person

2026-09-28 08:11:31 +02:00

release

Install only releases signed with the key built in; fetch a node's release on the control plane

2026-10-04 09:48:03 +02:00

router

Moderations name a judge's categories once, by name

2026-10-04 23:03:35 +02:00

safedial

gofmt what the security work left unformatted

2026-10-04 12:22:51 +02:00

scim

Match a mapped project however its path is spaced: the store writes "Acme / ml / train"

2026-10-04 16:45:47 +02:00

settings

Watch the cluster and edit every setting from the console

2026-10-03 22:54:09 +02:00

sim

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

sourcecheck

Keep the control plane's fetches off link-local addresses, and see through NAT64, 6to4 and proxies

2026-10-04 10:48:01 +02:00

store

Requests kept and replayed: keys requests per project with retention and a share, ctl request --body and --replay

2026-10-04 22:51:21 +02:00

tlsconf

Put etcd and Patroni's API on TLS, and move a running cluster there in maintenance mode

2026-10-04 12:07:17 +02:00

version

Switch the project language to English

2026-09-16 01:15:21 +02:00

web

Match a mapped project however its path is spaced: the store writes "Acme / ml / train"

2026-10-04 16:45:47 +02:00