Show each team's first-token and latency percentiles, errors and refusals
Percentiles are read from the histograms kept with the usage sums and shown per group on the usage tab and in the people page's panels. Requests refused by a limit are recorded as 429s against their owner, free of charge, so a team hitting its limits shows as such. Usage can be grouped by model. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
4454e1322c
commit
9f479b9a70
17 files changed
+418
-29
No files matched your search
@@ -40,7 +40,11 @@
|
||||
|
||||
{{if .Rows}}
|
||||
<table class="rows">
|
||||
<tr><th>Group</th><th class="num">Requests</th><th class="num">Tokens</th><th class="num">Spend</th><th class="num">Errors</th></tr>
|
||||
<tr><th>Group</th><th class="num">Requests</th><th class="num">Tokens</th><th class="num">Spend</th><th class="num">Errors</th>
|
||||
{{if .HasStats}}<th class="num" title="Failed requests, refusals by a limit included">Error rate</th>
|
||||
<th class="num" title="Refused by a rate, token or budget limit">Limited</th>
|
||||
<th class="num" title="Time to first token, for streamed requests">First token p50 / p95</th>
|
||||
<th class="num">Latency p95</th>{{end}}</tr>
|
||||
{{range .Rows}}
|
||||
<tr>
|
||||
<td>{{.Name}}</td>
|
||||
@@ -48,6 +52,11 @@
|
||||
<td class="num">{{compact .Tokens}}</td>
|
||||
<td class="num">{{.Spend}}</td>
|
||||
<td class="num">{{if .Errors}}{{.Errors}}{{else}}—{{end}}</td>
|
||||
{{if $.HasStats}}{{with .Stats}}
|
||||
<td class="num{{if ge .ErrorRate 5.0}} q-warn{{end}}">{{if .Requests}}{{pct1 .ErrorRate}}%{{else}}—{{end}}</td>
|
||||
<td class="num{{if .Limited}} q-warn{{end}}">{{if .Limited}}{{compact .Limited}}{{else}}—{{end}}</td>
|
||||
<td class="num">{{pctile .TTFT 50}} / {{pctile .TTFT 95}}</td>
|
||||
<td class="num">{{pctile .Latency 95}}</td>{{end}}{{end}}
|
||||
</tr>
|
||||
{{end}}
|
||||
</table>
|
||||
|
||||
Reference in new issue
Block a user