This website requires JavaScript.
Explore
Help
Sign In
ilker
/
llmgw
Watch
2
Star
0
Fork
1
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
95
Wiki
Activity
Files
59187cdae56752ffd4392665206dbe55019671b3
llmgw
/
internal
/
control
T
History
Ilker Manap
and
Claude Opus 5.5
59187cdae5
CI / test (push)
Successful in 10m37s
Details
A model can be stopped and kept, or removed with its files from the mirror and the nodes
...
Co-Authored-By: Claude Opus 5.5 (1M context) <
noreply@anthropic.com
>
2026-10-29 20:45:48 +01:00
..
adminapi
A model can be stopped and kept, or removed with its files from the mirror and the nodes
2026-10-29 20:45:48 +01:00
agentsvc
The control plane uses whichever mirror answers
2026-10-29 13:43:27 +01:00
catalog
A model can be stopped and kept, or removed with its files from the mirror and the nodes
2026-10-29 20:45:48 +01:00
fabrics
Watch each fabric's subnet managers, and keep a fabric one through a failover
2026-09-29 07:47:03 +02:00
fabrictest
Measure two nodes' fabric rail by rail: llmgw ctl fabric-test
2026-09-29 21:29:23 +02:00
facility
Facility-aware placement: racks, PDUs, holds and power caps
2026-10-05 01:17:49 +02:00
federation
Federation: another llmgw cluster as a provider, its models as PEER/MODEL
2026-10-05 01:21:30 +02:00
fleetmetrics
MIG: a card in MIG mode is placed as its instances, each a GPU of class <card>-mig-<profile>
2026-10-05 00:01:14 +02:00
inventory
Facility-aware placement: racks, PDUs, holds and power caps
2026-10-05 01:17:49 +02:00
modelserve
A served model can be moved to more cards, or fewer
2026-10-29 16:40:49 +01:00
modelsvc
A model can be stopped and kept, or removed with its files from the mirror and the nodes
2026-10-29 20:45:48 +01:00
nvlink
Find multi-node NVLink domains, place across them, and show them as racks
2026-09-29 09:07:59 +02:00
placement
A node given a role takes only what asks for it
2026-10-19 17:52:30 +02:00
quota
Guarantee and limit capacity per part of the tenancy tree
2026-09-30 18:15:38 +02:00
reconciler
A big model's download no longer runs out its startup timeout
2026-10-20 09:45:31 +02:00
topology
Map every InfiniBand fabric, draw it, and place replicas by it
2026-09-29 08:46:23 +02:00
train
LoRA adapters trained on the nodes: llmgw ctl train
2026-10-08 20:25:57 +02:00
control_test.go
Give every engine a key only the router holds
2026-09-30 00:38:29 +02:00
control.go
Several keys for one outside provider
2026-10-17 08:56:30 +02:00
enginechoice.go
The cluster's settings live in the store, and every change takes effect
2026-10-05 15:25:23 +02:00
external_test.go
Several keys for one outside provider
2026-10-17 08:56:30 +02:00
facility_test.go
Facility-aware placement: racks, PDUs, holds and power caps
2026-10-05 01:17:49 +02:00
facility.go
The cluster's settings live in the store, and every change takes effect
2026-10-05 15:25:23 +02:00
leadership_test.go
Leadership stays put while the store's primary is replaced
2026-10-15 23:17:58 +02:00
leadership.go
Leadership stays put while the store's primary is replaced
2026-10-15 23:17:58 +02:00
quotas.go
Scale and place by what a replica was measured to serve
2026-09-30 18:21:08 +02:00