2f595f5999
An adopted engine's state is written without its command; engine-check finds the installed build
Ilker ManapandClaude Opus 5.52026-10-07 14:26:28 +02:00
b5d650af16
What a replica computes on comes from nvidia-smi; llama.cpp says its layers only at -lv 4
Ilker ManapandClaude Opus 5.52026-10-07 14:04:08 +02:00
25b3e129fe
What a shard computes on survives the agent's and the control plane's restarts
Ilker ManapandClaude Opus 5.52026-10-07 13:51:40 +02:00
619dd751ab
Nodes show their engines' versions and GPUs' capability; a profile can ask for an engine version
Ilker ManapandClaude Opus 5.52026-10-07 13:06:57 +02:00
0bd0d881c5
A replica says what its engine computes on, and llama.cpp's word on the CPU refuses a GPU placement
Ilker ManapandClaude Opus 5.52026-10-07 13:02:17 +02:00
4721b8e353
Llama Guard 3's verdicts carry their hazards' names without a categories list
Ilker ManapandClaude Opus 5.52026-10-06 12:44:53 +02:00
249a91aeec
Guardrails turn off and on; a judge's refusal says which hazard; ctl guard judge ask
Ilker ManapandClaude Opus 5.52026-10-06 12:41:08 +02:00
f1a3199e55
KV routing tests wait for both replicas to be scraped: a replica not yet heard from is passed over, and the test was racing that
Ilker ManapandClaude Opus 5.52026-10-05 01:27:14 +02:00
117f417ef5
Precise KV-index routing: vLLM KV cache events through the agent, routed by leading blocks held
Ilker ManapandClaude Opus 5.52026-10-05 01:21:11 +02:00
0416b827fd
ctl bench reads a guarded engine's metrics with the engine's key, or says why it cannot
Ilker ManapandClaude Opus 5.52026-10-05 00:20:25 +02:00
8cc8d7139b
SGLang read in its own metric names, started serving them, and asked for its own help
Ilker ManapandClaude Opus 5.52026-10-05 00:20:25 +02:00
9f5a4bf11f
The about page's fonts carry Turkish letters: latin-ext subsets beside the latin ones
Ilker ManapandClaude Opus 5.52026-10-05 00:18:08 +02:00
a13a519386
CHANGELOG and BACKLOG for C17-C23 and the first parts of C24; README lists the new docs
Ilker ManapandClaude Opus 5.52026-10-05 00:17:16 +02:00
bae16426a2
Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane
Ilker ManapandClaude Opus 5.52026-10-05 00:13:39 +02:00
11231d8c2b
The portal in English and Turkish: a catalogue per language, a switcher at the foot of every page, landing.language, Turkish numbers and dates
Ilker ManapandClaude Opus 5.52026-10-05 00:12:53 +02:00
f0477f140d
Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate
Ilker ManapandClaude Opus 5.52026-10-05 00:04:43 +02:00
11b5d44702
A Terraform provider for llmgw: models, quotas and guard attachments through the admin API
Ilker ManapandClaude Opus 5.52026-10-05 00:04:35 +02:00
e725adc2f0
Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node
Ilker ManapandClaude Opus 5.52026-10-05 00:03:17 +02:00
0fd55a862b
MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>
Ilker ManapandClaude Opus 5.52026-10-05 00:01:14 +02:00
44f3a9e31d
Reusing answers: a response cache per project, exact match, opt-in with a TTL
Ilker ManapandClaude Opus 5.52026-10-04 23:50:53 +02:00
a95c519bc5
The admin API described in OpenAPI 3.1: generated from a route table by docgen, served at /api/v1/openapi.json
Ilker ManapandClaude Opus 5.52026-10-04 23:47:59 +02:00
30f7f3474a
Forgetting a person and keeping requests in the cluster: users forget, keys residency --in-cluster
Ilker ManapandClaude Opus 5.52026-10-04 23:27:31 +02:00
35657c1417
Secrets in Vault: env: and vault: references wherever a secret file is named, and the store's own secrets sealed under a master key — Vault transit or a local key
Ilker ManapandClaude Opus 5.52026-10-04 23:21:44 +02:00
bce54f0941
Scaling by the clock: schedule windows with their own min and max, prewarm, control.timezone
Ilker ManapandClaude Opus 5.52026-10-04 23:16:56 +02:00
5b92ae0277
Token-level timing and admission by SLO: TPOT, inter-token and tokens a second by model and tenant; a model past its SLO is saturated for the lower bands
Ilker ManapandClaude Opus 5.52026-10-04 23:13:18 +02:00
10466416df
server restore: an archive checked, dry-run, and put back — configuration with modes and owners, the store in SQLite or PostgreSQL; backup_copy_to copies archives off the machine
Ilker ManapandClaude Opus 5.52026-10-04 23:09:59 +02:00