Ilker ManapandClaude Opus 5.5 a16097cfe8 Serve vision models with their projector and original weights on vLLM; group the mirror by version ...

model serve takes --projector, fetched beside the weights and loaded by
llama.cpp with --mmproj, and --format safetensors with --gpu-class and --tp,
which fetches the weights with their config and tokenizer and runs them on
vLLM. The console offers both, F switching between GGUF and original
weights. The mirror view is one row per version with its files on Enter.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-04 00:42:59 +02:00

..

engine.go

Decide engines per node, and let a node join without one it cannot run

2026-10-01 12:07:25 +02:00

engines_test.go

Launch multi-node vLLM its own way by default, not through Ray

2026-09-29 09:13:59 +02:00

llamacpp_test.go

Serve vision models with their projector and original weights on vLLM; group the mirror by version

2026-10-04 00:42:59 +02:00

llamacpp.go

Serve vision models with their projector and original weights on vLLM; group the mirror by version

2026-10-04 00:42:59 +02:00

probe_test.go

Stop placing engines on nodes that do not have them

2026-09-27 16:11:55 +02:00

probe.go

Install vLLM on every GPU node that can run it, as llama.cpp is

2026-09-29 13:15:54 +02:00

sglang.go

Give every engine a key only the router holds

2026-09-30 00:38:29 +02:00

sim_test.go

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

sim.go

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

unsafeenv.go

Stop a browser page, or a model definition, from running code on the nodes

2026-09-30 00:29:52 +02:00

vllm.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00