CI / test (push) Successful in 1m35s
A quota could be enforced and reported, and set nowhere but a shell. Nothing in the browser showed one at all — not what a team may spend, not what it has spent, not that it had no limit. In practice that means quotas nobody sets. /admin/quotas lists the whole tree, whether or not a group has a limit: the one without a quota is the one most likely to need one, so it cannot be the row the page leaves out. Spend over the last thirty days sits beside the budget, with the fraction used. Setting a quota here is a change of position. It was kept to the shell because raising a budget is a financial act and a stolen admin session should not perform one. That argument holds for exactly one row on this page: resolution takes the most restrictive value along the chain, so raising a team's or a project's limit cannot exceed what the organization allows. Only an organization's own limit is bounded by nothing. Every change is logged with who made it and what it was before. Per-key limits stay on the CLI. A key belongs to a person and is already bounded by its project; letting an admin session reach individual keys would put every caller's throughput one click away, and the page refuses a key scope rather than rendering it and failing later. A limit an ancestor already caps lower is marked as written-but-unreachable. Resolution means a project given more than its team is not a bigger budget, it is a number nobody will reach — and without saying so the page would show it as though it applied, with the first sign being a refusal that disagrees with the screen. The group is chosen, not typed. Ids became random in the previous commit so two organizations could both have a "platform" team, which also made them impossible to remember and a typo impossible to notice: it would write a quota onto nothing and report success. A blank field is no limit of that kind, not zero — zero is a limit of nothing, which refuses every request. Clearing removes the row rather than writing nulls across it: both resolve the same, only one tells a reader nobody has set a limit here. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
101 lines
4.6 KiB
HTML
101 lines
4.6 KiB
HTML
{{define "admin_quotas"}}<!doctype html>
|
|
<html lang="en"><head>
|
|
<meta charset="utf-8"><meta name="viewport" content="width=device-width,initial-scale=1">
|
|
<title>Quotas · llmgw</title><link rel="stylesheet" href="/_static/base.css">
|
|
</head><body><div class="wrap">
|
|
<header>
|
|
<h1>Quotas</h1>
|
|
<p class="sub">What each organization, team and project may use · spend over the last {{.Since}}</p>
|
|
<nav><a href="/admin">cluster</a> <a href="/admin/users">accounts</a>
|
|
<a href="/profile">your keys</a></nav>
|
|
</header>
|
|
|
|
{{if .Error}}<p class="error">{{.Error}}</p>{{end}}
|
|
{{if .Message}}<p class="ok">{{.Message}}</p>{{end}}
|
|
|
|
{{if .Rows}}
|
|
<table>
|
|
<tr><th>Where</th><th>RPM</th><th>TPM</th><th>Budget</th><th>Spent</th><th>Used</th><th></th></tr>
|
|
{{range .Rows}}
|
|
<tr>
|
|
<td style="padding-left:{{.Indent}}.6rem">
|
|
{{if eq .Indent 0}}<strong>{{.Path}}</strong>{{else}}{{.Path}}{{end}}
|
|
<span class="opt">{{.Scope}}</span>
|
|
</td>
|
|
<td class="num">{{if .RPM}}{{.RPM}}{{else}}—{{end}}</td>
|
|
<td class="num">{{if .TPM}}{{.TPM}}{{else}}—{{end}}</td>
|
|
<td class="num">{{if .Budget}}{{.Budget}}{{if .Period}}/{{.Period}}{{end}}{{else}}—{{end}}</td>
|
|
<td class="num">{{.Spend}}</td>
|
|
<td class="meter">{{if .HasPct}}<span style="width:{{pct .Percent 100}}%"></span><em>{{.Percent}}%</em>{{else}}—{{end}}</td>
|
|
<td>
|
|
<form method="post" action="/admin/quotas" class="inline">
|
|
<input type="hidden" name="csrf" value="{{$.CSRF}}">
|
|
<input type="hidden" name="scope" value="{{.Scope}}">
|
|
<input type="hidden" name="id" value="{{.ID}}">
|
|
<input type="hidden" name="clear" value="1">
|
|
<button type="submit" class="link danger"{{if not .HasAny}} disabled{{end}}>Clear</button>
|
|
</form>
|
|
</td>
|
|
</tr>
|
|
{{if .Shadowed}}
|
|
{{/* A value that is written here and never reached. Resolution takes the most
|
|
restrictive along the chain, so without saying so the page would show a
|
|
number as though it applied and the first sign would be a refusal that
|
|
disagrees with the screen. */}}
|
|
<tr><td colspan="7" class="error-row">written here, but {{.Shadowed}}</td></tr>
|
|
{{end}}
|
|
{{if .Models}}<tr><td colspan="7" class="url-row">only: <code>{{.Models}}</code></td></tr>{{end}}
|
|
{{end}}
|
|
</table>
|
|
{{else}}
|
|
<p class="empty">Nothing to give a quota to yet. Make an organization on the
|
|
<a href="/admin/users">accounts page</a> first.</p>
|
|
{{end}}
|
|
|
|
<h2>Set a quota</h2>
|
|
<form method="post" action="/admin/quotas">
|
|
<input type="hidden" name="csrf" value="{{.CSRF}}">
|
|
{{/* Chosen, not typed. Ids are random so that two organizations can both
|
|
have a "platform" team, which makes them impossible to remember and a
|
|
typo impossible to notice — it would write a quota onto nothing. */}}
|
|
<label>Where
|
|
<select name="target" required>
|
|
{{range .Rows}}<option value="{{.Scope}}:{{.ID}}">{{.Scope}} · {{.Crumb}}</option>
|
|
{{end}}
|
|
</select></label>
|
|
<div class="field-row">
|
|
<label>Requests / minute <span class="opt">blank for none</span>
|
|
<input type="text" name="rpm" placeholder="60"></label>
|
|
<label>Tokens / minute <span class="opt">blank for none</span>
|
|
<input type="text" name="tpm" placeholder="100000"></label>
|
|
<label>Budget <span class="opt">blank for none</span>
|
|
<input type="text" name="budget" placeholder="1000"></label>
|
|
<label>per
|
|
<select name="period">
|
|
<option value="month">month</option>
|
|
<option value="day">day</option>
|
|
</select></label>
|
|
</div>
|
|
<label>Only these models <span class="opt">comma separated; blank allows all</span>
|
|
<input type="text" name="models" placeholder="qwen2.5-1.5b-instruct, qwen-1.5b"></label>
|
|
<button type="submit">Set</button>
|
|
</form>
|
|
|
|
<p class="note">A quota written here is shared by everything beneath it: two
|
|
people on one team spend the same budget, which is the number that will refuse
|
|
them. Whatever is set is replaced wholesale — a field left blank means no limit
|
|
of that kind at this level, not "leave what was there".</p>
|
|
|
|
<p class="note">Limits compose downward by taking the most restrictive value, so
|
|
a team cannot raise what its organization set and a project cannot raise its
|
|
team's. Only an organization's own limit is bounded by nothing. Model lists
|
|
intersect rather than add: a project cannot allow a model its team withheld.</p>
|
|
|
|
<p class="note">Still not here, deliberately: per-key limits. A key is issued by
|
|
the person who owns it and bounded by the project it belongs to, and letting an
|
|
admin session reach individual keys would put every caller's throughput one
|
|
click away — <code>llmgw keys limits --scope key</code> for that.</p>
|
|
|
|
<footer><span>llmgw {{.Version}}</span><span>{{.Now}}</span></footer>
|
|
</div></body></html>{{end}}
|