A gateway serving nine models offered nine names and nothing to choose between them. /v1/models is the only view most clients ever have, and it listed ids. Models carry a description now: written when the model is added, shown on the dashboard and sent to clients in /v1/models. Written rather than derived. A registry offers a pipeline tag and a wall of README, and neither answers the question somebody picking from a list is asking — which of these should I send this request to. "General chat, strong Swedish; slower than the 8B" is not in any metadata field. It is optional, and absent means absent rather than an empty string in the response: a model nobody described should read as undescribed, not as described with nothing. On the dashboard it sits under its row rather than in a column. A sentence in a table cell either wraps every other column into a stripe or gets cut off. Co-Authored-By: Claude Opus 5 (1M context) <moreply@anthropic.com>
This commit is contained in:
1 parent
e0ea4f6be9
commit
d998ea7ef5
8 files changed
+86
-11
No files matched your search
@@ -84,6 +84,7 @@ rather than repeated.
|
||||
| `timeout` | `time.Duration` | [Mirror](#mirror) |
|
||||
| `name` | `string` | [Model](#model) |
|
||||
| `aliases` | `[]string` | [Model](#model) |
|
||||
| `description` | `string` | [Model](#model) |
|
||||
| `source` | `string` | [Model](#model) |
|
||||
| `profiles` | `[]Profile` | [Model](#model) |
|
||||
| `scaling` | `Scaling` | [Model](#model) |
|
||||
@@ -632,6 +633,21 @@ arriving long after this deadline has passed.
|
||||
|
||||
`[]string`
|
||||
|
||||
### `description`
|
||||
|
||||
`string`
|
||||
|
||||
Description is what this model is for, in a line.
|
||||
|
||||
Written by whoever added it, because nobody else can say it. A registry
|
||||
offers a pipeline tag and a wall of README, and neither answers the
|
||||
question a person picking from a list is asking: which of these nine
|
||||
names should I send this request to.
|
||||
|
||||
It reaches clients through /v1/models, which is the only view most of
|
||||
them ever see. A gateway serving nine models by name alone makes that
|
||||
choice by guesswork.
|
||||
|
||||
### `source`
|
||||
|
||||
`string`
|
||||
|
||||
Reference in new issue
Block a user