diff --git a/CHANGELOG.md b/CHANGELOG.md index cb1fb85..dde9e54 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -18,7 +18,7 @@ is only released once its **exit criterion** is met, not when its code lands. | v0.11.0 | — | High availability from setup, the setup and console screens, usage sums and per-tenant alerts | released | | v0.12.0 | — | The cluster's settings in the store, in force when changed; the firewall switch; wipe | released | | v0.13.0 | — | The whole system stopped and started from one command; Qwen3Guard judges, on a GPU and CPUs together | released | -| v0.14.0 | — | Knowledge bases: documents from people's own machines, kept apart per tenant, answered from | released (v0.14.1: adapters, the tree over the API, the firewall on every machine) | +| v0.14.0 | — | Knowledge bases: documents from people's own machines, kept apart per tenant, answered from | released (v0.14.1: adapters, the tree over the API, the firewall on every machine; v0.14.2: pictures from ComfyUI) | | v1.0.0 | 5 | Tenancy, prefix affinity, benchmarking | planned | Until v1.0.0 the minor version is the breaking one: configuration formats and Go @@ -26,6 +26,75 @@ APIs change between minors without a deprecation period. ## Unreleased +## v0.14.2 — 2026-10-10 + +Pictures: OpenAI's `/v1/images/generations`, made by ComfyUI on the +cluster's own cards. The agents install ComfyUI themselves, the gateway +prices pictures by the picture, and the portal has a page to make them. +Also: on-demand models that survive a failover, and knowledge-base +embeddings fixes. + +**Upgrading.** +- The store gains a column (`usage.images`); nothing to do. +- **ComfyUI is installed only where asked**: `llmgw ctl config set + engines.comfyui 0.39.2` has every node with an NVIDIA GPU build it (about + 10 GB under `/opt/llmgw/engines`). Nodes need this release to install it + or run engine `comfyui`. + +### Added + +- **Pictures at `/v1/images/generations`**, OpenAI's shape, through the same + key, allowlist, limit, admission and guardrail checks as any request. A + model with profiles on engine `comfyui` is placed on a GPU node like any + other. A ComfyUI server outside the cluster can be an external model with + `api: comfyui` instead. The workflow is a built-in (`flux-schnell`, the + default, or `flux-dev`) or a JSON file in ComfyUI's API format, with + `{{prompt}}`, `{{width}}`, `{{seed}}` and the like where the request's + values go. Requests may also send `seed`, `steps`, `negative_prompt` and + `guidance`. The seed used comes back in `x-llmgw-seed`. Pictures come back + as `b64_json`; ComfyUI's workflow is stripped from each PNG, and a client + that leaves takes its workflow off the queue. `/v1/models` says `images` + for such a model. +- **Engine `comfyui`.** ComfyUI asks for no key, so the agent starts it + behind `llmgw comfyui-gate`. ComfyUI listens on the loopback only. The + gate listens on the replica's port, demands the replica's key, and lets + through only what the router asks. The model's `comfyui:` block names + the workflow and, for a source that is a set of files, the checkpoint. +- **The agents install ComfyUI** (`engines.comfyui`). The release's source is + checked against a digest llmgw holds, since GitHub publishes none, and a + version without one is refused. Its requirements are resolved as PyPI + stood the day after the release, with PyPI's CUDA 13 torch or PyTorch's + CUDA 12.9 one for an older driver, and the result is checked on the card. + A ComfyUI installed by hand is named by `engines.comfyui.dir` in + agent.yaml. +- **A price per picture**: `per_image` in `auth.pricing`, on top of the + prompt's tokens. A model priced only per picture is not free, so a spent + budget still stops it. Each usage row keeps how many pictures were made, + shown by `llmgw ctl request`. +- **`/images` on the portal**, beside the chat, for the models that make + pictures. The chat no longer offers them. The page offers size, how many, + seed, steps and a negative prompt, and shows each picture with its seed + and a download link. Nothing is kept but the usage. +- **An embedding model's `query_prefix`**, put before the question a + knowledge-base search embeds and never before documents, for Qwen3-Embedding + and models trained like it. + +### Fixed + +- **An awake on-demand model survived no restart or change of leader of the + control plane.** A control plane that had heard no requests read every + on-demand replica its nodes reported as wanted by nobody, and drained them + all. An adopted replica now gets a whole idle timeout. +- `ctl models` said `not placed` for an on-demand model that had been woken + and was serving; it now says `ready (on demand)`. +- A batch of embeddings was refused as one over-long prompt when the + passages together exceeded the context, though each one fit. The longest + input is what has to fit. +- The chat's kept conversation sat in the browser under one key for + everybody, so the next person to sign in on the same browser opened the + last one's conversation. It is kept per account, and signing out clears + what the pages stored. + ## v0.14.1 — 2026-10-09 Adapters trained on the nodes from a knowledge base and kept private to diff --git a/README.md b/README.md index 3b2b4df..ef4302e 100644 --- a/README.md +++ b/README.md @@ -40,7 +40,7 @@ Releases track the roadmap phases; see [CHANGELOG.md](CHANGELOG.md). | v0.11.0 | — | High availability from setup, the setup and console screens, usage sums and per-tenant alerts | released | | v0.12.0 | — | The cluster's settings in the store, in force when changed; the firewall switch; wipe | released | | v0.13.0 | — | The whole system stopped and started from one command; Qwen3Guard judges, on a GPU and CPUs together | released | -| v0.14.0 | — | Knowledge bases: documents from people's own machines, kept apart per tenant, answered from | released (v0.14.1: adapters, the tree over the API, the firewall on every machine) | +| v0.14.0 | — | Knowledge bases: documents from people's own machines, kept apart per tenant, answered from | released (v0.14.1: adapters, the tree over the API, the firewall on every machine; v0.14.2: pictures from ComfyUI) | | v1.0.0 | 5 | Tenancy, prefix affinity, benchmarking | planned | As of v0.6.0 a cluster runs unattended: agents report their hardware, the