Ilker ManapandClaude Opus 5.5 1b89d5cdea Say on the chat page whether a GPU or a CPU answered ...

A model with replicas on a card and on CPUs answered at either speed with no
way to tell which. The picker names where each model runs, each reply names
the hardware that served it, and every answer carries x-llmgw-hardware.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-03 18:57:50 +02:00

..

account

Close what a second security review found still open

2026-09-30 02:25:07 +02:00

accounting

Tell clients how much of their rate limit is left

2026-09-30 02:42:21 +02:00

agent

Judge a card shared with another process every heartbeat, not once

2026-10-03 18:46:23 +02:00

auth

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

bench

Give every engine a key only the router holds

2026-09-30 00:38:29 +02:00

cli

Choose each engine's build from the node's hardware, for every GPU generation

2026-10-01 14:35:58 +02:00

config

Decide engines per node, and let a node join without one it cannot run

2026-10-01 12:07:25 +02:00

control

Judge a card shared with another process every heartbeat, not once

2026-10-03 18:46:23 +02:00

docgen

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

doctor

Choose each engine's build from the node's hardware, for every GPU generation

2026-10-01 14:35:58 +02:00

gguf

Format kind_live_test.go

2026-10-01 07:20:35 +02:00

hf

Mirror a many-file model whole, with its checksums, for vLLM

2026-10-01 12:21:04 +02:00

mirror

Mirror a many-file model whole, with its checksums, for vLLM

2026-10-01 12:21:04 +02:00

modelplan

Make the planned entry use an engine that can serve the precision

2026-09-17 07:48:20 +02:00

obs

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

onboard

Fail a node only for the fabrics it declares

2026-10-01 12:13:18 +02:00

promq

Show usage over time, per organization, team, project and person

2026-09-28 08:11:31 +02:00

release

Sign releases, and install only signed ones once a key is trusted

2026-09-30 23:03:48 +02:00

router

Say on the chat page whether a GPU or a CPU answered

2026-10-03 18:57:50 +02:00

sim

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

sourcecheck

Say when a replica is running an edited profile, and check a source from the web too

2026-09-27 22:42:26 +02:00

store

Give each GPU node a vLLM build it can run, chosen on the cluster page

2026-10-01 12:39:14 +02:00

tlsconf

Park a model that fails every time it starts, and say so everywhere

2026-09-30 01:21:57 +02:00

version

Switch the project language to English

2026-09-16 01:15:21 +02:00

web

Say on the chat page whether a GPU or a CPU answered

2026-10-03 18:57:50 +02:00