Record section B's state after trying it on the PoC
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
bd4736125b
commit
4df30fc175
1 file changed
+14
+14
@@ -192,6 +192,20 @@ missing ruleset. Make it skippable with `--no-firewall`.
|
||||
|
||||
## B. Guardrails (M–L, build in this order)
|
||||
|
||||
**Status (2026-10-04, branch `guardrails-b`):** B1–B4 done, and tried live on
|
||||
the PoC. That found four bugs, all fixed with tests:
|
||||
- a shadow default merged with an attached policy of unwritten mode left it
|
||||
in shadow;
|
||||
- a streamed word held back at one release was dropped at the next;
|
||||
- llama.cpp continues a conversation ending on the answer, so Llama Guard's
|
||||
verdict on answers is now asked with its own prompt as a completion;
|
||||
- a judge model was named in a client's "no endpoint" error.
|
||||
|
||||
The PoC runs `observe` (shadow) for everyone, and Llama Guard 3 1B
|
||||
(`llama-guard-3-1b`, CPU, on cuda01) as a judge, which blocks a harmful
|
||||
request in ~0.7s and a harmful answer in ~1.4s there. Still left: see each
|
||||
item.
|
||||
|
||||
Today nothing on the request path reads, classifies, redacts or filters
|
||||
message text in either direction (confirmed; the only "moderation" hit is a
|
||||
comment in `internal/router/budget_fallback.go:20`). Existing controls are
|
||||
|
||||
Reference in new issue
Block a user