This website requires JavaScript.
Explore
Help
Sign In
ilker
/
llmgw
Watch
2
Star
0
Fork
1
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
95
Wiki
Activity
Files
2eb96f487207845a8968c5fa8e660fc4d4defe85
llmgw
/
internal
/
agent
/
engines
T
History
Ilker Manap
and
Claude Opus 5.5
f41c96d30f
CI / test (push)
Successful in 9m42s
Details
Strata's DeepSeek not offered on cards its engine was not built for, and refused there by the agent
...
Co-Authored-By: Claude Opus 5.5 (1M context) <
noreply@anthropic.com
>
2026-10-30 13:00:21 +01:00
..
comfyui_test.go
The agent hands the gate the repository a node loads its weights by
2026-10-12 23:28:22 +02:00
comfyui.go
ComfyUI models of one environment share one replica
2026-10-14 13:55:34 +02:00
compute_test.go
A replica says what its engine computes on, and llama.cpp's word on the CPU refuses a GPU placement
2026-10-07 13:02:17 +02:00
compute.go
A replica says what its engine computes on, and llama.cpp's word on the CPU refuses a GPU placement
2026-10-07 13:02:17 +02:00
engine.go
Weights from Hugging Face pinned to a commit and checked against the sha256 it published
2026-10-30 07:33:15 +01:00
engines_test.go
Strata runs as an engine: a 125B MoE on one card
2026-10-29 15:09:13 +01:00
kvevents_test.go
Precise KV-index routing: vLLM KV cache events through the agent, routed by leading blocks held
2026-10-05 01:21:11 +02:00
llamacpp_test.go
Serve vision models with their projector and original weights on vLLM; group the mirror by version
2026-10-04 00:42:59 +02:00
llamacpp.go
engine-check computes a token on the GPU, and finds the installed llama.cpp
2026-10-07 13:04:38 +02:00
lora_test.go
LoRA adapters on vLLM, loaded on demand with replica affinity: max_loaded_adapters
2026-10-05 01:14:38 +02:00
lora.go
LoRA adapters on vLLM, loaded on demand with replica affinity: max_loaded_adapters
2026-10-05 01:14:38 +02:00
mig_test.go
MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>
2026-10-05 00:01:14 +02:00
pickle_test.go
Fixes from the second review: grants, flags, updates, setup
2026-10-29 12:31:07 +01:00
probe_test.go
Stop placing engines on nodes that do not have them
2026-09-27 16:11:55 +02:00
probe.go
Install vLLM on every GPU node that can run it, as llama.cpp is
2026-09-29 13:15:54 +02:00
sglang.go
Weights that run code are refused
2026-10-25 23:17:22 +01:00
sim_test.go
Onboard a node with a script, and find two examples that never worked
2026-09-16 12:28:36 +02:00
sim.go
Have engines listen on the management address, and take SGLang's key off its command line
2026-10-04 10:36:42 +02:00
strata_test.go
Strata's DeepSeek not offered on cards its engine was not built for, and refused there by the agent
2026-10-30 13:00:21 +01:00
strata.go
Strata's DeepSeek not offered on cards its engine was not built for, and refused there by the agent
2026-10-30 13:00:21 +01:00
trtllm_test.go
TensorRT-LLM as an engine, and models from Ollama into the mirror
2026-10-05 00:02:01 +02:00
trtllm.go
TensorRT-LLM as an engine, and models from Ollama into the mirror
2026-10-05 00:02:01 +02:00
unsafeenv_test.go
Refuse profile env and args that would run code or touch files on the nodes
2026-10-04 09:54:45 +02:00
unsafeenv.go
Strata runs as an engine: a 125B MoE on one card
2026-10-29 15:09:13 +01:00
vllm.go
Weights that run code are refused
2026-10-25 23:17:22 +01:00