A node that cannot run the CUDA 13 build installs the same version's CUDA 12.9 build from vLLM's GitHub release, with PyTorch's cu129 torch; the install computes on the GPU before it counts. The build can be chosen per node — auto, cu13, cu129, none — on the cluster page, with ctl engine-build, or over the admin API; the control plane keeps the choice and tells the node at once. Refs #2. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
12 lines
436 B
SQL
12 lines
436 B
SQL
-- The build of an engine chosen for a node, where it is not left to the
|
|
-- node's hardware: vLLM's CUDA 12.9 build on a node that could run CUDA 13's,
|
|
-- or no vLLM at all. A node with no row here installs what its hardware runs.
|
|
CREATE TABLE node_engines (
|
|
node_id TEXT NOT NULL,
|
|
engine TEXT NOT NULL,
|
|
variant TEXT NOT NULL,
|
|
updated_at BIGINT NOT NULL,
|
|
updated_by TEXT NOT NULL,
|
|
PRIMARY KEY (node_id, engine)
|
|
);
|