Ilker ManapandClaude Opus 5.5 dbcecd1e85 Judge an answer with Llama Guard 3's own prompt, as a completion, not a conversation ending on the answer ...

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-04 15:35:57 +02:00

..

admission

Displace the newest lowest-band request when the gateway queue is full

2026-09-30 23:07:53 +02:00

breaker

Phase 1 (1/2): scheduler pipeline, endpoint registry, metric scraping

2026-09-16 01:15:21 +02:00

endpoint

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

prefix

Add approximate prefix routing, and find out it did nothing

2026-09-16 12:13:19 +02:00

proxy

Add the guard interface, and filter hooks in the proxy for buffered and streamed answers

2026-10-04 12:16:00 +02:00

scheduler

Spill a saturated pool's requests to the next pool

2026-09-30 23:23:32 +02:00

scrape

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

activate.go

Park a model that fails every time it starts, and say so everywhere

2026-09-30 01:21:57 +02:00

adapter_test.go

Serve LoRA adapters on llama.cpp models, asked for by name

2026-09-30 23:40:47 +02:00

admin_test.go

Give metrics a door that does not also open onto pprof

2026-09-17 18:12:10 +02:00

admin.go

Give metrics a door that does not also open onto pprof

2026-09-17 18:12:10 +02:00

adminauth_test.go

Guard the admin API and pprof with a token only root and the server can read

2026-10-04 10:02:44 +02:00

adminauth.go

Guard the admin API and pprof with a token only root and the server can read

2026-10-04 10:02:44 +02:00

adminguard_test.go

Stop a browser page, or a model definition, from running code on the nodes

2026-09-30 00:29:52 +02:00

adminguard.go

Stop a browser page, or a model definition, from running code on the nodes

2026-09-30 00:29:52 +02:00

budget_fallback.go

Price a request by the model that serves it

2026-09-28 00:15:40 +02:00

chat_load_test.go

Show a model loading in the chat, and send once it is up

2026-09-28 20:52:31 +02:00

chat_load.go

Show a model loading in the chat, and send once it is up

2026-09-28 20:52:31 +02:00

chat_models_test.go

Let the chat be stopped, timed, tuned and kept across a reload

2026-09-29 09:54:23 +02:00

chat.go

Say on the chat page whether a GPU or a CPU answered

2026-10-03 18:57:50 +02:00

context_limit_test.go

Know how big a model's context is, and what it can do

2026-09-16 23:07:49 +02:00

context_limit.go

Know how big a model's context is, and what it can do

2026-09-16 23:07:49 +02:00

external_test.go

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

finish_test.go

Displace the newest lowest-band request when the gateway queue is full

2026-09-30 23:07:53 +02:00

guard_test.go

Judge an answer with Llama Guard 3's own prompt, as a completion, not a conversation ending on the answer

2026-10-04 15:35:57 +02:00

guard.go

Guardrail metrics and alerts: checks, latency, judge failures, fail-open, redactions, stopped streams, tenant blocks

2026-10-04 15:11:50 +02:00

guardmetrics.go

Guardrail metrics and alerts: checks, latency, judge failures, fail-open, redactions, stopped streams, tenant blocks

2026-10-04 15:11:50 +02:00

handlers.go

The /admin/guard page, a Guardrails link, and the policies in force on the profile page

2026-10-04 15:15:38 +02:00

hardware_leader_test.go

Add a standby control plane with server add, and draw the screens as windows

2026-10-03 22:29:12 +02:00

hardware_test.go

Say on the chat page whether a GPU or a CPU answered

2026-10-03 18:57:50 +02:00

judge.go

Judge an answer with Llama Guard 3's own prompt, as a completion, not a conversation ending on the answer

2026-10-04 15:35:57 +02:00

memory.go

no_store: refuse conversations, notes and models outside the cluster under a policy that keeps nothing

2026-10-04 12:36:02 +02:00

metrics.go

Guardrail metrics and alerts: checks, latency, judge failures, fail-open, redactions, stopped streams, tenant blocks

2026-10-04 15:11:50 +02:00

pages_auth_test.go

Connect an editor from the account page, and serve the Responses API

2026-09-29 10:04:17 +02:00

pricing_test.go

Publish per-tenant request and budget series, and alert on them

2026-10-03 19:55:24 +02:00

responses_test.go

Hook a guard into the router: judge requests before dispatch and filter answers as they are relayed

2026-10-04 12:20:24 +02:00

responses.go

Hook a guard into the router: judge requests before dispatch and filter answers as they are relayed

2026-10-04 12:20:24 +02:00

router_listen_test.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

router_test.go

List in /v1/models only the models the key may use

2026-10-04 10:49:54 +02:00

router.go

The /admin/guard page, a Guardrails link, and the policies in force on the profile page

2026-10-04 15:15:38 +02:00

tenantmetrics.go

Publish per-tenant request and budget series, and alert on them

2026-10-03 19:55:24 +02:00

threadid_test.go

Guard a GPU-less node's problems, and bound thread ids

2026-10-04 10:49:10 +02:00

threads_test.go

Stop the text-search comment naming one language

2026-09-27 08:09:49 +02:00

threads.go

no_store: refuse conversations, notes and models outside the cluster under a policy that keeps nothing

2026-10-04 12:36:02 +02:00

trace_test.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

trace.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00