Ilker ManapandClaude Opus 5.5 8b122aae09 A judge the leader serves by itself is sized as init's is ...

A judge a policy names and the catalog lacked was served with 3 GB, no
cores and llama.cpp's prompt cache; on a busy node its judgments missed
their budget and fail: closed refused the requests. It now gets init's
2 GB and cores, and every judge modelserve serves runs with
--cache-ram 0.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-19 16:32:04 +02:00

..

admin-api.md

Organizations, teams, projects, keys and memberships in the admin API

2026-10-08 22:42:43 +02:00

admin-api.openapi.json

A judge the leader serves by itself is sized as init's is

2026-10-19 16:32:04 +02:00

choosing-models.md

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

client-api.openapi.json

Pictures, 3D models, a vision model and workflows as tools at /mcp

2026-10-14 13:11:09 +02:00

clients.md

MCP takes pictures of real size, by id too, and waits for a cold model

2026-10-15 07:24:59 +02:00

console.md

A node's console opens on what the machine is doing

2026-10-19 12:55:27 +02:00

data.md

Merge C18 offline bundles and the Helm chart

2026-10-05 00:15:47 +02:00

development.md

Docs: one way in — quick-install starts at the setup screens, quickstart becomes development, install.md no longer says engines are yours to install

2026-10-04 17:32:54 +02:00

fabrics.md

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

facility-aware-placement.md

Facility-aware placement: racks, PDUs, holds and power caps

2026-10-05 01:17:49 +02:00

guardrails.md

Qwen3Guard is the judge, and judges on a GPU and on CPUs are asked in turn

2026-10-08 10:22:47 +02:00

install.md

Sign-in is set up from the console, and a directory tried before it is kept

2026-10-19 12:55:27 +02:00

knowledge.md

A band may wait longer than the rest; a busy refusal says when to return

2026-10-10 16:11:09 +02:00

kubernetes.md

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

node-onboarding.md

Add a node with one command: llmgw node add, with a terminal screen

2026-09-29 19:33:47 +02:00

onboarding.md

A forgotten password is set through a one-time link

2026-10-07 13:20:11 +02:00

quick-install.md

Qwen3Guard is the judge, and judges on a GPU and on CPUs are asked in turn

2026-10-08 10:22:47 +02:00

reference.md

Sign-in is set up from the console, and a directory tried before it is kept

2026-10-19 12:55:27 +02:00