SLO fields described
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
5b92ae0277
commit
74429f1c00
3 files changed
+12
-3
No files matched your search
@@ -1747,10 +1747,15 @@ point and avoids depending on the script being on PATH.
|
||||
|
||||
`time.Duration`
|
||||
|
||||
TTFTp99 is the time to the first token 99 requests in 100 are within.
|
||||
|
||||
### `tpot_p99`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
TPOTp99 is the time per output token, after the first, 99 streamed
|
||||
requests in 100 are within.
|
||||
|
||||
## Scaling
|
||||
|
||||
### `min`
|
||||
|
||||
Reference in new issue
Block a user