Ilker ManapandClaude Opus 5.5 3e7dd20bad One machine runs one judge, on up to four cores ...

A second judge replica on the same machine shares its cores and is lost
with it, so it bought nothing but half the speed of each. On a 4-core,
8 GB single-machine install, one judge on four cores passed 20 of 20
requests at about 3.5 s each, judged in and out. Two judges on two cores
each had passed 19 of 20.

server init now serves one judge when this machine is the only node, and
two, on two cores each and spread over the nodes, where there will be
others (HA setups, or a control plane that is not a node).
--judge-replicas and the setup's Copies still choose. install.md gives
the measured times in place of "half a second".

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-16 19:35:42 +02:00

..

admin-api.md

Organizations, teams, projects, keys and memberships in the admin API

2026-10-08 22:42:43 +02:00

admin-api.openapi.json

ComfyUI models of one environment share one replica

2026-10-14 13:55:34 +02:00

choosing-models.md

Manage people and the tenancy tree, from the web and the CLI

2026-09-28 16:26:39 +02:00

client-api.openapi.json

Pictures, 3D models, a vision model and workflows as tools at /mcp

2026-10-14 13:11:09 +02:00

clients.md

MCP takes pictures of real size, by id too, and waits for a cold model

2026-10-15 07:24:59 +02:00

console.md

Collections a part of the tree answers from when a request names none

2026-10-08 15:52:43 +02:00

data.md

Merge C18 offline bundles and the Helm chart

2026-10-05 00:15:47 +02:00

development.md

Docs: one way in — quick-install starts at the setup screens, quickstart becomes development, install.md no longer says engines are yours to install

2026-10-04 17:32:54 +02:00

fabrics.md

Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

2026-09-29 21:29:23 +02:00

facility-aware-placement.md

Facility-aware placement: racks, PDUs, holds and power caps

2026-10-05 01:17:49 +02:00

guardrails.md

Qwen3Guard is the judge, and judges on a GPU and on CPUs are asked in turn

2026-10-08 10:22:47 +02:00

install.md

One machine runs one judge, on up to four cores

2026-10-16 19:35:42 +02:00

knowledge.md

A band may wait longer than the rest; a busy refusal says when to return

2026-10-10 16:11:09 +02:00

kubernetes.md

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

node-onboarding.md

Add a node with one command: llmgw node add, with a terminal screen

2026-09-29 19:33:47 +02:00

onboarding.md

A forgotten password is set through a one-time link

2026-10-07 13:20:11 +02:00

quick-install.md

Qwen3Guard is the judge, and judges on a GPU and on CPUs are asked in turn

2026-10-08 10:22:47 +02:00

reference.md

Leadership stays put while the store's primary is replaced

2026-10-15 23:17:58 +02:00