diff --git a/BACKLOG.md b/BACKLOG.md index f4893d8..0562b49 100644 --- a/BACKLOG.md +++ b/BACKLOG.md @@ -192,6 +192,20 @@ missing ruleset. Make it skippable with `--no-firewall`. ## B. Guardrails (M–L, build in this order) +**Status (2026-10-04, branch `guardrails-b`):** B1–B4 done, and tried live on +the PoC. That found four bugs, all fixed with tests: +- a shadow default merged with an attached policy of unwritten mode left it + in shadow; +- a streamed word held back at one release was dropped at the next; +- llama.cpp continues a conversation ending on the answer, so Llama Guard's + verdict on answers is now asked with its own prompt as a completion; +- a judge model was named in a client's "no endpoint" error. + +The PoC runs `observe` (shadow) for everyone, and Llama Guard 3 1B +(`llama-guard-3-1b`, CPU, on cuda01) as a judge, which blocks a harmful +request in ~0.7s and a harmful answer in ~1.4s there. Still left: see each +item. + Today nothing on the request path reads, classifies, redacts or filters message text in either direction (confirmed; the only "moderation" hit is a comment in `internal/router/budget_fallback.go:20`). Existing controls are