SLO fields described

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
Ilker ManapandClaude Opus 5.5 committed 2026-10-04 23:13:30 +02:00
1 parent 5b92ae0277
commit 74429f1c00
3 files changed
+12 -3

No files matched your search

+5
View File
@@ -1747,10 +1747,15 @@ point and avoids depending on the script being on PATH.
`time.Duration`
TTFTp99 is the time to the first token 99 requests in 100 are within.
### `tpot_p99`
`time.Duration`
TPOTp99 is the time per output token, after the first, 99 streamed
requests in 100 are within.
## Scaling
### `min`