Give the mirror a page, so managing it is not a curl command
/admin/mirror, behind the same admin session as the other admin pages. What is held, what is arriving with its byte count, what failed and why; start a fetch, retry a failed one, remove a version. Not mounted at all without a mirror configured. The right page for a deployment with no mirror is no page, rather than an empty one pointing at nothing. It reloads itself only while something is downloading. A reload at any other moment takes with it whatever is half-typed into the fetch form, and there is nothing to watch when nothing is moving. A failed row offers Retry, not Remove. A fetch that failed left nothing on disk, so the remove could only answer "the mirror holds nothing for this" — a button whose single outcome is a confusing error. Starting the same download again is what somebody looking at that row wants, and the mirror allows it: only a download still running is refused. An unreachable mirror is said outright instead of rendering as an empty table. The two look nearly identical and mean opposite things: one is a mirror waiting to be filled, the other is a machine to go and look at. Dashboard takes NavExtras rather than a second bool. Two adjacent booleans at a call site get swapped silently and are discovered by somebody clicking the wrong link. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
744a283cf1
commit
cd7eedf09e
17 files changed
+889
-24
No files matched your search
@@ -77,6 +77,9 @@ rather than repeated.
|
||||
| `notice` | `string` | [Landing](#landing) |
|
||||
| `bin` | `string` | [LlamaCppConfig](#llamacppconfig) |
|
||||
| `parallel` | `int` | [LlamaCppConfig](#llamacppconfig) |
|
||||
| `api` | `string` | [Mirror](#mirror) |
|
||||
| `tls` | `tlsconf.Config` | [Mirror](#mirror) |
|
||||
| `timeout` | `time.Duration` | [Mirror](#mirror) |
|
||||
| `name` | `string` | [Model](#model) |
|
||||
| `aliases` | `[]string` | [Model](#model) |
|
||||
| `source` | `string` | [Model](#model) |
|
||||
@@ -149,6 +152,7 @@ rather than repeated.
|
||||
| `threads` | `Threads` | [Server](#server) |
|
||||
| `landing` | `Landing` | [Server](#server) |
|
||||
| `agent_tls` | `tlsconf.Config` | [Server](#server) |
|
||||
| `mirror` | `Mirror` | [Server](#server) |
|
||||
| `router` | `Router` | [Server](#server) |
|
||||
| `control` | `Control` | [Server](#server) |
|
||||
| `models` | `[]catalog.Model` | [Server](#server) |
|
||||
@@ -559,6 +563,38 @@ Parallel is how many requests a server handles at once, when a profile
|
||||
does not say. llama.cpp defaults to one, which would make every second
|
||||
request wait behind the first no matter what the router decided.
|
||||
|
||||
## Mirror
|
||||
|
||||
### `api`
|
||||
|
||||
`string`
|
||||
|
||||
API is the mirror's management address, scheme included, for example
|
||||
https://models.internal:8082. Empty means no mirror is configured.
|
||||
|
||||
The management port, not the one nodes fetch bytes from. Those are two
|
||||
listeners on the mirror precisely so this one can be locked down without
|
||||
re-certifying every agent's fetcher.
|
||||
|
||||
### `tls`
|
||||
|
||||
`tlsconf.Config`
|
||||
|
||||
TLS authenticates to the mirror's management API, with the same CA the
|
||||
agents use. Empty leaves the connection in plain HTTP, which is only
|
||||
acceptable on a network where nothing untrusted can reach that port —
|
||||
the mirror says as much in its own log when it starts that way.
|
||||
|
||||
Takes a [Config](#config) block.
|
||||
|
||||
### `timeout`
|
||||
|
||||
`time.Duration`
|
||||
|
||||
Timeout bounds a management call. It does not bound a download: the
|
||||
mirror answers a fetch as soon as it has started one, and the bytes keep
|
||||
arriving long after this deadline has passed.
|
||||
|
||||
## Model
|
||||
|
||||
### `name`
|
||||
@@ -1054,6 +1090,15 @@ trusted certificate, while this one is mutual and private.
|
||||
|
||||
Takes a [Config](#config) block.
|
||||
|
||||
### `mirror`
|
||||
|
||||
`Mirror`
|
||||
|
||||
Mirror points the control plane at a model mirror it can administer.
|
||||
Empty means there is none, and /admin/mirror stays unmounted.
|
||||
|
||||
Takes a [Mirror](#mirror) block.
|
||||
|
||||
### `router`
|
||||
|
||||
`Router`
|
||||
|
||||
Reference in new issue
Block a user