More of OpenAI's API: Responses structured output, images and previous_response_id; rerank, score and audio passed through; moderations by the judge
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
32ff1dbd6f
commit
9136bc71c2
12 files changed
+549
-5
No files matched your search
@@ -959,6 +959,18 @@ Or open `/chat` in a browser and use it without a key at all — the page carrie
|
||||
your session, and the request still goes through admission, rate limits, budget
|
||||
and accounting exactly as an API call does.
|
||||
|
||||
### What the client port answers
|
||||
|
||||
| Path | What |
|
||||
|---|---|
|
||||
| `POST /v1/chat/completions`, `/v1/completions`, `/v1/embeddings` | OpenAI's, served by the models in the catalog |
|
||||
| `POST /v1/responses` | OpenAI's Responses API, translated to chat completions: tools, `text.format` (structured output), `input_image` (by URL or `data:` URL), and `previous_response_id` — the conversation is kept as a thread, so the project must keep conversations (`llmgw keys threads`); `store: false` keeps none |
|
||||
| `POST /v1/rerank`, `/v1/score` | passed through to an engine that serves them: vLLM with a reranker or a cross-encoder |
|
||||
| `POST /v1/audio/transcriptions`, `/v1/audio/translations` | the multipart form passed through as it came, to an engine that serves speech to text: vLLM with Whisper |
|
||||
| `POST /v1/moderations` | answered by the guardrails' judge model (`role: guard`): `flagged`, and the judge's own categories |
|
||||
| `/v1/files`, `/v1/batches` | batches; see [Batches](#batches) |
|
||||
| `GET /v1/models` | the models this key may use |
|
||||
|
||||
## Watching it
|
||||
|
||||
The control plane exports both halves on one endpoint: what the cluster is
|
||||
|
||||
Reference in new issue
Block a user