Qwen3Guard is the judge, and judges on a GPU and on CPUs are asked in turn
Llama Guard 3 1B could not tell ordinary coding requests from harmful ones: on the PoC it scored "continue" 0.51, "continue the code above" 0.89 and "how do I kill all child processes in bash" 0.92 unsafe, against 0.97 to 1.00 for harmful requests, at Q4_K_M and Q8_0 alike, with its own template. A site had "continue" refused. Qwen3Guard-Gen 0.6B gave the ordinary ones 0.15 at the most and the harmful ones 1.00, in 0.8 GB on CPUs. - format qwen3guard: its prompt written out as its template writes it, for requests and answers, and its Safe / Unsafe / Controversial verdict read; controversial counts as the policy's judge.controversial says, safe by default. - judge.models: judges asked in turn, the first that answers deciding; a failure is recorded against the judge that failed. guard judge use sets the order, replacing categories none of the judges names. - known judges (Qwen3Guard 0.6B/4B/8B, Llama Guard 1B/8B): guard judge enable serves any of them, --gpu the 4B on the roomiest GPU class as a standard model; the leader fetches and serves one a policy names that the catalog lacks. - server init installs qwen3guard-0.6b with the baseline's categories. - a judge reads a long text by its start and end, which fit its context, rather than overflowing it and refusing the request under fail: closed. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
63f7c8cfd7
commit
b0273ffb5f
24 files changed
+1313
-208
No files matched your search
+10
-13
@@ -10,6 +10,7 @@ import (
|
||||
"time"
|
||||
|
||||
"gitea.mynodes.xyz/ilker/llmgw/internal/control/catalog"
|
||||
"gitea.mynodes.xyz/ilker/llmgw/internal/guard"
|
||||
"gitea.mynodes.xyz/ilker/llmgw/internal/mirror"
|
||||
)
|
||||
|
||||
@@ -586,28 +587,24 @@ func argInt(args []string, flag string) int {
|
||||
return 0
|
||||
}
|
||||
|
||||
// isJudgeWeights is whether a source is a guard model's weights: Llama
|
||||
// Guard, which reads a conversation and says whether it is safe.
|
||||
func isJudgeWeights(source string) bool {
|
||||
return strings.Contains(strings.ToLower(source), "llama-guard")
|
||||
}
|
||||
|
||||
// asJudge makes a model built from the serve form a judge when its weights
|
||||
// are one's: role guard, Llama Guard's format, under the name the policies
|
||||
// give their judge when they give one and the form gave another. It says
|
||||
// whether it did, and the name the form gave when it was changed.
|
||||
// are one's — Llama Guard, Qwen3Guard, ShieldGemma: role guard, that judge's
|
||||
// format, under the name the policies give their judge when they give one
|
||||
// and the form gave another. It says whether it did, and the name the form
|
||||
// gave when it was changed.
|
||||
func (p *AccountPages) asJudge(m *catalog.Model) (judge bool, renamed string) {
|
||||
if !isJudgeWeights(m.Source) {
|
||||
format, ok := guard.FormatOfWeights(m.Source)
|
||||
if !ok {
|
||||
return false, ""
|
||||
}
|
||||
m.Role, m.Guard, m.RoutingProfile = catalog.RoleGuard, &catalog.GuardModel{Format: "llamaguard3"}, ""
|
||||
m.Role, m.Guard, m.RoutingProfile = catalog.RoleGuard, &catalog.GuardModel{Format: format}, ""
|
||||
if p.guardLibrary == nil {
|
||||
return true, ""
|
||||
}
|
||||
asked := map[string]bool{}
|
||||
for _, pol := range p.guardLibrary().Policies {
|
||||
if pol.Judge != nil && pol.Judge.Model != "" {
|
||||
asked[pol.Judge.Model] = true
|
||||
for _, j := range pol.Judge.Judges() {
|
||||
asked[j] = true
|
||||
}
|
||||
}
|
||||
if asked[m.Name] || len(asked) != 1 {
|
||||
|
||||
Reference in new issue
Block a user