Ilker ManapandClaude Opus 5.5 c64af74085 Merge C23 TensorRT-LLM engine and Ollama/GGUF import ...

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-05 00:02:50 +02:00

..

engine.go

Merge C23 TensorRT-LLM engine and Ollama/GGUF import

2026-10-05 00:02:50 +02:00

engines_test.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

llamacpp_test.go

Serve vision models with their projector and original weights on vLLM; group the mirror by version

2026-10-04 00:42:59 +02:00

llamacpp.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

mig_test.go

MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>

2026-10-05 00:01:14 +02:00

probe_test.go

Stop placing engines on nodes that do not have them

2026-09-27 16:11:55 +02:00

probe.go

Install vLLM on every GPU node that can run it, as llama.cpp is

2026-09-29 13:15:54 +02:00

sglang.go

Have engines listen on the management address, and take SGLang's key off its command line

2026-10-04 10:36:42 +02:00

sim_test.go

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

sim.go

Have engines listen on the management address, and take SGLang's key off its command line

2026-10-04 10:36:42 +02:00

trtllm_test.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

trtllm.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

unsafeenv_test.go

Refuse profile env and args that would run code or touch files on the nodes

2026-10-04 09:54:45 +02:00

unsafeenv.go

TensorRT-LLM as an engine, and models from Ollama into the mirror

2026-10-05 00:02:01 +02:00

vllm.go

Have engines listen on the management address, and take SGLang's key off its command line

2026-10-04 10:36:42 +02:00