Ilker ManapandClaude Opus 5.5 cbd5521f4f Place llama.cpp across several GPUs of a node with gpus_per_node ...

tp on a llama.cpp profile was a width nothing placed. gpus_per_node is
now the count: placement reserves that many cards on one node and the
engine splits layers across them. tp, pp and nodes are refused with
what to write instead.

Refs #2 (item 8).

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-01 11:56:34 +02:00

..

catalog_test.go

Place llama.cpp across several GPUs of a node with gpus_per_node

2026-10-01 11:56:34 +02:00

catalog.go

Place llama.cpp across several GPUs of a node with gpus_per_node

2026-10-01 11:56:34 +02:00

cpu_test.go

Add the llama.cpp engine, and let a profile ask for no GPU

2026-09-16 08:14:05 +02:00

live.go

Let the catalog change while the cluster is running

2026-09-17 01:08:21 +02:00