Batches: OpenAI's Files and Batch APIs, served at the lowest priority under a store lease, each line a request of the key that made it
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
889be70b8f
commit
841ee21c12
19 files changed
+1775
-10
No files matched your search
+8
-1
@@ -431,7 +431,14 @@ portal is not done — the page shows; the console and ctl change.
|
||||
weighted routing across two revisions/aliases (scheduler filter, alias
|
||||
resolution in `router/router.go:569`), a header/key pin, automatic
|
||||
rollback on error-rate or TTFT regression from per-replica metrics.
|
||||
8. **Batch API and Files (M–L).** `/v1/files`, `/v1/batches`, JSONL
|
||||
8. **Done (branch `features-c2`):** `/v1/files` and `/v1/batches`
|
||||
(OpenAI's shape), worker under a store lease, lines kept as served,
|
||||
lowest band, usage tagged `batch=<id>`, output and error files with
|
||||
retention, `no_store` refused. Left: the Responses API (`/v1/responses`)
|
||||
as a batch endpoint; the console and `ctl` do not list batches (an
|
||||
operator sees them through usage tags); a file is one row in the store,
|
||||
so a store backup carries batch files with it.
|
||||
**Batch API and Files (M–L).** `/v1/files`, `/v1/batches`, JSONL
|
||||
storage, a worker feeding the bronze band, accounting. New
|
||||
`internal/router/batch`.
|
||||
9. **Request/response logging and replay (M).** Opt-in per project with
|
||||
|
||||
Reference in new issue
Block a user