A machine too small for the models it would serve is said so first
CI / test (push) Successful in 8m42s
CI / test (push) Successful in 8m42s
A control plane that is also a node, serving the starter model and two judges, needs about 10.5 GB: 3.5 for itself, 2 for the starter, 2 for each judge, and one more because the scheduler counts whole gigabytes. On 8 GB the install did every step and then had nowhere to run the starter. The setup's checks now fail this machine's memory and name what it would serve, and server init refuses before it installs anything, naming the flags that leave those models off it. quick-install.md said 8 GB; it says 12. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
06baa38858
commit
d110968243
10 files changed
+131
-5
No files matched your search
@@ -37,7 +37,7 @@
|
||||
"install.req.names.text": "A hostname of its own on each machine. It becomes the machine's name in the cluster.",
|
||||
"install.req.gpus": "GPU nodes",
|
||||
"install.req.gpus.text": "Added later, with the NVIDIA driver installed. llmgw installs llama.cpp, vLLM, Python and CUDA itself.",
|
||||
"install.req.memory_note": "<strong>Memory, when the first machine also serves models.</strong> In this recording it runs the starter model and both guardrail judges. With 8 GB there was no room left for the starter model; with 12 GB everything fits.",
|
||||
"install.req.memory_note": "<strong>Memory, when the first machine also serves models.</strong> In this recording it runs the starter model and both guardrail judges, and needs 12 GB; the setup checks this before it installs anything, and says what to turn off on a smaller machine.",
|
||||
"install.binary.title": "Get llmgw",
|
||||
"install.binary.intro": "One static file, the same on every machine. Only the first needs it: setup copies it to the others.",
|
||||
"install.binary.text": "The latest release, its checksum checked. <code>sha256sum</code> must say <code>OK</code>; if it does not, the download is damaged.",
|
||||
|
||||
@@ -37,7 +37,7 @@
|
||||
"install.req.names.text": "Her makinenin kendine ait bir adı (hostname). Kümede makinenin adı bu olur.",
|
||||
"install.req.gpus": "GPU düğümleri",
|
||||
"install.req.gpus.text": "Sonradan, NVIDIA sürücüsü kurulu olarak eklenir. llama.cpp, vLLM, Python ve CUDA'yı llmgw kendisi kurar.",
|
||||
"install.req.memory_note": "<strong>İlk makine model de çalıştırıyorsa bellek.</strong> Bu kayıtta ilk makine başlangıç modelini ve iki koruma hakemini birlikte çalıştırıyor. 8 GB ile başlangıç modeline yer kalmadı; 12 GB ile hepsi sığıyor.",
|
||||
"install.req.memory_note": "<strong>İlk makine model de çalıştıracaksa bellek.</strong> Bu kayıtta ilk makine başlangıç modelini ve iki koruma hakemini birlikte çalıştırıyor ve 12 GB istiyor; kurulum bunu bir şey kurmadan önce denetler ve daha küçük bir makinede neyin kapatılacağını söyler.",
|
||||
"install.binary.title": "llmgw'yi edinin",
|
||||
"install.binary.intro": "Tek bir statik dosya, her makinede aynı. Yalnızca ilk makinede gerekir: kurulum onu diğerlerine kendisi kopyalar.",
|
||||
"install.binary.text": "Son sürüm, sağlama toplamı denetlenerek. <code>sha256sum</code> <code>OK</code> demelidir; demiyorsa indirme bozuktur.",
|
||||
|
||||
Reference in new issue
Block a user