Merge C18 offline bundles and the Helm chart
Conflicts: server.go imports (both kept); agent.pb.go regenerated with buf from the merged proto. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
commit
6f85c17fc5
51 files changed
+4177
-63
No files matched your search
@@ -139,6 +139,8 @@ rather than repeated.
|
||||
| `roles` | `map[string][]string` | [OIDC](#oidc) |
|
||||
| `memberships` | `map[string]string` | [OIDC](#oidc) |
|
||||
| `no_passwords` | `bool` | [OIDC](#oidc) |
|
||||
| `mirror` | `string` | [Offline](#offline) |
|
||||
| `checksums` | `string` | [Offline](#offline) |
|
||||
| `nvidia_smi` | `string` | [Options](#options) |
|
||||
| `ib_root` | `string` | [Options](#options) |
|
||||
| `prefer_nvml` | `bool` | [Options](#options) |
|
||||
@@ -257,6 +259,7 @@ rather than repeated.
|
||||
| `monitoring` | `Monitoring` | [Server](#server) |
|
||||
| `tracing` | `obs.Tracing` | [Server](#server) |
|
||||
| `mirror` | `Mirror` | [Server](#server) |
|
||||
| `offline` | `Offline` | [Server](#server) |
|
||||
| `engines` | `map[string]string` | [Server](#server) |
|
||||
| `engine_overrides` | `[]EngineOverride` | [Server](#server) |
|
||||
| `backup_dir` | `string` | [Server](#server) |
|
||||
@@ -1273,6 +1276,29 @@ PasswordSignIn off refuses passwords on the sign-in form: people come
|
||||
in through the provider only. Administrators still can, so a broken
|
||||
provider does not lock everybody out.
|
||||
|
||||
## Offline
|
||||
|
||||
### `mirror`
|
||||
|
||||
`string`
|
||||
|
||||
Mirror is the mirror's file address, as nodes reach it:
|
||||
http://10.0.0.5:8081 — the port model files are served on, not the
|
||||
management API. Set, the cluster is offline: nodes install engines
|
||||
from it and never from their publishers, releases come from it unless
|
||||
releases names another place, and no registry is asked whether a
|
||||
model has newer weights. Python engines (vLLM, SGLang) come from PyPI,
|
||||
which no bundle carries; on an offline node they are installed by hand.
|
||||
|
||||
### `checksums`
|
||||
|
||||
`string`
|
||||
|
||||
Checksums is the file of engine checksums this control plane trusts,
|
||||
kept by llmgw bundle import and llmgw bundle trust; every engine file
|
||||
a node fetches from the mirror is checked against it. Read again
|
||||
whenever it changes. Empty is /etc/llmgw/offline.sha256.
|
||||
|
||||
## Options
|
||||
|
||||
### `nvidia_smi`
|
||||
@@ -2128,6 +2154,16 @@ Empty means there is none, and /admin/mirror stays unmounted.
|
||||
|
||||
Takes a [Mirror](#mirror) block.
|
||||
|
||||
### `offline`
|
||||
|
||||
`Offline`
|
||||
|
||||
Offline is a cluster that reaches nothing outside itself: its nodes
|
||||
install engines, and upgrades fetch releases, from the mirror, out of
|
||||
a bundle carried in (llmgw bundle create, llmgw bundle import).
|
||||
|
||||
Takes a [Offline](#offline) block.
|
||||
|
||||
### `engines`
|
||||
|
||||
`map[string]string`
|
||||
|
||||
Reference in new issue
Block a user