Ilker ManapandClaude Opus 5.5 f5d6210b86 Install engines on any glibc system, with its own package manager ...

The llama.cpp build is published from Ubuntu but is not Ubuntu's in any way
that matters: it needs glibc 2.34 and GCC 12's libstdc++, which Debian 12
and RHEL 10 have and RHEL 9 does not. Refusing every system not called
"ubuntu" turned away the first two for their name. The build is now tried
everywhere, and ldd decides.

What ldd says is made readable. "/lib64/libstdc++.so.6: version
`GLIBCXX_3.4.30' not found" is a system too old for the build, and is
reported as "libstdc++.so.6 is too old (needs GLIBCXX_3.4.30)", once —
rather than as a missing library that is plainly installed.

Packages are named per family — libgomp1 for Debian's, libgomp for Red
Hat's — and installed with whichever of apt-get, dnf, yum or zypper the
machine has, decided from ID_LIKE rather than a list of distribution names.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-09-28 11:10:06 +02:00

..

discover_test.go

Report node memory even when GPU discovery fails

2026-09-16 23:50:53 +02:00

discover.go

Let a node describe itself instead of being described by hand

2026-09-28 10:13:42 +02:00

fabrics_test.go

Stop trusting hardware facts that were never checked

2026-09-17 17:29:15 +02:00

fabrics.go

Stop trusting hardware facts that were never checked

2026-09-17 17:29:15 +02:00

gpu_nonvml.go

Phase 2 (2/2): NVML backend behind a build tag

2026-09-16 02:05:25 +02:00

gpu_nvml.go

Phase 2 (2/2): NVML backend behind a build tag

2026-09-16 02:05:25 +02:00

gpu_smi.go

Let a node describe itself instead of being described by hand

2026-09-28 10:13:42 +02:00

gpu_test.go

Export what the cluster is made of, not only what it is serving

2026-09-17 15:09:27 +02:00

gpu.go

Let a node say how much room it has left

2026-09-18 09:38:57 +02:00

host.go

Install engines on any glibc system, with its own package manager

2026-09-28 11:10:06 +02:00

ib_test.go

Phase 2 (1/2): node discovery, engine adapters, process supervisor

2026-09-16 02:01:59 +02:00

ib.go

Phase 2 (1/2): node discovery, engine adapters, process supervisor

2026-09-16 02:01:59 +02:00

json_test.go

Phase 2 (1/2): node discovery, engine adapters, process supervisor

2026-09-16 02:01:59 +02:00

memory_test.go

Place on nodes that can actually hold the model

2026-09-16 23:12:44 +02:00

memory.go

Place on nodes that can actually hold the model

2026-09-16 23:12:44 +02:00

storage_test.go

Let a node say how much room it has left

2026-09-18 09:38:57 +02:00

storage.go

Let a node say how much room it has left

2026-09-18 09:38:57 +02:00

weights_test.go

Know where the weights are, without owning the storage

2026-09-17 08:21:16 +02:00

weights.go

Know where the weights are, without owning the storage

2026-09-17 08:21:16 +02:00