-
611fddd236
Describe v0.10.3
v0.10.3

Ilker ManapandClaude Opus 5.5
2026-09-30 00:38:55 +02:00
-
9853936e0b
Give every engine a key only the router holds

Ilker ManapandClaude Opus 5.5
2026-09-30 00:38:29 +02:00
-
d167686cf1
Stop a browser page, or a model definition, from running code on the nodes

Ilker ManapandClaude Opus 5.5
2026-09-30 00:29:52 +02:00
-
97dc49cbeb
Keep the mirror's management API and its downloads off the network behind it

Ilker ManapandClaude Opus 5.5
2026-09-30 00:27:27 +02:00
-
3a26277c32
Refuse names that leave their directory, on the mirror and the agent

Ilker ManapandClaude Opus 5.5
2026-09-30 00:24:48 +02:00
-
7062645bcb
Describe v0.10.2
v0.10.2

Ilker ManapandClaude Opus 5.5
2026-09-29 22:37:28 +02:00
-
bb90a927aa
Print only what must outlive init's screen, and drop bubbles

Ilker ManapandClaude Opus 5.5
2026-09-29 22:37:28 +02:00
-
49c446271c
Describe v0.10.1
v0.10.1

Ilker ManapandClaude Opus 5.5
2026-09-29 22:17:33 +02:00
-
b5f412f9df
Put the mirror on its own machine in two commands

Ilker ManapandClaude Opus 5.5
2026-09-29 22:17:24 +02:00
-
a1b5daceb8
Let server init ask for what it needs, and node add take several nodes

Ilker ManapandClaude Opus 5.5
2026-09-29 21:54:18 +02:00
-
7071c67487
Show which requests each node's agent answers

Ilker ManapandClaude Opus 5.5
2026-09-29 21:31:05 +02:00
-
7bb360fc78
Measure two nodes' fabric rail by rail: llmgw ctl fabric-test

Ilker ManapandClaude Opus 5.5
2026-09-29 21:29:23 +02:00
-
af6f8e023e
Describe v0.10.0
v0.10.0

Ilker ManapandClaude Opus 5.5
2026-09-29 21:06:42 +02:00
-
590e5b9f3e
Ask a node only for engines it can install; doctor says when AVX2 is hidden

Ilker ManapandClaude Opus 5.5
2026-09-29 21:03:03 +02:00
-
2a16c26575
Add a node with one command: llmgw node add, with a terminal screen

Ilker ManapandClaude Opus 5.5
2026-09-29 19:33:47 +02:00
-
c8da06988f
Add a quick install guide: six steps from empty servers to a model

Ilker ManapandClaude Opus 5.5
2026-09-29 18:13:05 +02:00
-
4c5a2fd6da
Install vLLM on every GPU node that can run it, as llama.cpp is

Ilker ManapandClaude Opus 5.5
2026-09-29 13:15:54 +02:00
-
e751c89937
Serve the project's website at /about, with its fonts in the binary

Ilker ManapandClaude Opus 5.5
2026-09-29 10:44:45 +02:00
-
80e0dd252f
Document what changed since v0.9.2, and fabrics for the sites that have them

Ilker ManapandClaude Opus 5.5
2026-09-29 10:14:58 +02:00
-
f989e67e1a
Connect an editor from the account page, and serve the Responses API

Ilker ManapandClaude Opus 5.5
2026-09-29 10:04:17 +02:00
-
b7e8e1a3a1
Let the chat be stopped, timed, tuned and kept across a reload

Ilker ManapandClaude Opus 5.5
2026-09-29 09:54:23 +02:00
-
0823e5d743
Fit the pages to a phone, and drop an empty Fabrics heading

Ilker ManapandClaude Opus 5.5
2026-09-29 09:24:56 +02:00
-
b18c9c3378
Start a mirror download where it was asked for

Ilker ManapandClaude Opus 5.5
2026-09-29 09:21:21 +02:00
-
4dba2a54ea
Tighten the People page

Ilker ManapandClaude Opus 5.5
2026-09-29 09:18:38 +02:00
-
ac7f5063b6
Give every choice-link one pill, and stop the NVLink page breaking them

Ilker ManapandClaude Opus 5.5
2026-09-29 09:15:44 +02:00
-
45e3f52da3
Launch multi-node vLLM its own way by default, not through Ray

Ilker ManapandClaude Opus 5.5
2026-09-29 09:13:59 +02:00
-
20479a2d5f
Find multi-node NVLink domains, place across them, and show them as racks

Ilker ManapandClaude Opus 5.5
2026-09-29 09:07:59 +02:00
-
5bbc619a31
Map every InfiniBand fabric, draw it, and place replicas by it

Ilker ManapandClaude Opus 5.5
2026-09-29 08:46:23 +02:00
-
23648fa19a
Watch each fabric's subnet managers, and keep a fabric one through a failover

Ilker ManapandClaude Opus 5.5
2026-09-29 07:47:03 +02:00
-
77fe801892
Tell independent fabrics apart by their subnet manager, not their name

Ilker ManapandClaude Opus 5.5
2026-09-29 07:29:16 +02:00
-
51f1606b53
Resolve the management address from the servers list too

Ilker ManapandClaude Opus 5.5
2026-09-29 05:07:15 +02:00
-
1b1ca67e35
Add llmgw doctor: what a node's GPUs, NVLink and fabric need, checked

Ilker ManapandClaude Opus 5.5
2026-09-29 03:51:09 +02:00
-
4d9284ce9f
Find each node's management interface, and lift the agent's memlock limit

Ilker ManapandClaude Opus 5.5
2026-09-29 01:44:59 +02:00
-
3ba36e23a6
Choose a shard's GPUs by NVLink, nearness to the fabric and NUMA

Ilker ManapandClaude Opus 5.5
2026-09-29 00:19:52 +02:00
-
9ee21dc814
Fix what a multi-node launch would have got wrong on real hardware

Ilker ManapandClaude Opus 5.5
2026-09-29 00:17:31 +02:00
-
93bd16f00e
Watch InfiniBand ports while the agent runs, not only when it starts

Ilker ManapandClaude Opus 5.5
2026-09-29 00:13:54 +02:00
-
bf2d171e89
Read NVLink and GPU-to-adapter distance from nvidia-smi topo

Ilker ManapandClaude Opus 5.5
2026-09-29 00:09:26 +02:00
-
22bb098247
Group the mirror's table by model family, not by exact name

Ilker ManapandClaude Opus 5.5
2026-09-28 23:44:55 +02:00
-
06ea02dd57
Group what the mirror holds by model

Ilker ManapandClaude Opus 5.5
2026-09-28 23:39:44 +02:00
-
7c5938effe
Keep node names on one line in the node table

Ilker ManapandClaude Opus 5.5
2026-09-28 23:31:36 +02:00
-
9ae526302b
Label chart axes in binary sizes and small percents, and windows in words

Ilker ManapandClaude Opus 5.5
2026-09-28 23:30:01 +02:00
-
fe0875ee05
Say why an engine's memory can exceed its node's RAM in use

Ilker ManapandClaude Opus 5.5
2026-09-28 23:26:54 +02:00
-
daed835d88
Measure each node's CPU and memory, and give every node a page

Ilker ManapandClaude Opus 5.5
2026-09-28 23:21:23 +02:00
-
b06fb9f51f
Lead the cluster page with its health and refresh it in place

Ilker ManapandClaude Opus 5.5
2026-09-28 22:56:27 +02:00
-
1f27935570
gofmt the account page's handler

Ilker ManapandClaude Opus 5.5
2026-09-28 22:52:32 +02:00
-
16a1e8b4d8
Show a person their own use and what is left of their budgets

Ilker ManapandClaude Opus 5.5
2026-09-28 22:51:13 +02:00
-
6b1f8b0827
Render a finished chat reply as markdown

Ilker ManapandClaude Opus 5.5
2026-09-28 22:44:18 +02:00
-
9b663eb23c
Name people and projects in usage reports, and total a usage legend

Ilker ManapandClaude Opus 5.5
2026-09-28 22:37:21 +02:00
-
ff86e52126
Open a repository beneath its row in the mirror's listing

Ilker ManapandClaude Opus 5.5
2026-09-28 22:11:38 +02:00
-
3fea39feb9
Show a Hugging Face repository's model card on the mirror page

Ilker ManapandClaude Opus 5.5
2026-09-28 22:03:19 +02:00
-
02fa639657
Open the mirror's registry on what is current, not an empty search box

Ilker ManapandClaude Opus 5.5
2026-09-28 21:56:58 +02:00
-
5aa5675a9c
Show a model loading in the chat, and send once it is up

Ilker ManapandClaude Opus 5.5
2026-09-28 20:52:31 +02:00
-
f13b18149a
Refuse weights the nodes' llama.cpp cannot load, before fetching them

Ilker ManapandClaude Opus 5.5
2026-09-28 20:44:36 +02:00
-
c609805e4b
Line up how each mirrored model runs

Ilker ManapandClaude Opus 5.5
2026-09-28 20:44:36 +02:00
-
bf94cd1667
Set how a model runs from the mirror page

Ilker ManapandClaude Opus 5.5
2026-09-28 20:34:41 +02:00
-
d8cefd8b21
Say there are no organizations rather than 404

Ilker ManapandClaude Opus 5.5
2026-09-28 20:23:19 +02:00
-
e493b2f53d
Give an organization's managers a page of their own

Ilker ManapandClaude Opus 5.5
2026-09-28 19:23:12 +02:00
-
098886e0e4
Let a person belong to many places, or to none

Ilker ManapandClaude Opus 5.5
2026-09-28 19:03:46 +02:00
-
429c05a319
Show on the quotas page the limits that actually apply

Ilker ManapandClaude Opus 5.5
2026-09-28 18:19:49 +02:00
-
be9f45aa94
Write the bar chart's latency the way its table does

Ilker ManapandClaude Opus 5.5
2026-09-28 18:11:27 +02:00
-
c1926be869
Tidy the dashboard and the forms around it

Ilker ManapandClaude Opus 5.5
2026-09-28 18:08:16 +02:00
-
5e1494f76d
Give the menu the new token after a password change

Ilker ManapandClaude Opus 5.5
2026-09-28 17:57:18 +02:00
-
c9cd25efc2
Draw one menu on every page

Ilker ManapandClaude Opus 5.5
2026-09-28 17:55:36 +02:00
-
c22c3a309b
Describe v0.9.2
v0.9.2

Ilker ManapandClaude Opus 5.5
2026-09-28 16:50:12 +02:00
-
42fa602247
Make a new control plane serve a model by itself

Ilker ManapandClaude Opus 5.5
2026-09-28 16:49:55 +02:00
-
5501f77805
Describe v0.9.1
v0.9.1

Ilker ManapandClaude Opus 5.5
2026-09-28 16:37:43 +02:00
-
75d69a6b9c
Show the mirror one line per model version

Ilker ManapandClaude Opus 5.5
2026-09-28 16:36:36 +02:00
-
beae60a76e
Describe v0.9.0
v0.9.0

Ilker ManapandClaude Opus 5.5
2026-09-28 16:27:54 +02:00
-
3104f4b706
Manage people and the tenancy tree, from the web and the CLI

Ilker ManapandClaude Opus 5.5
2026-09-28 16:26:39 +02:00
-
5141e4b138
Describe v0.8.8
v0.8.8

Ilker ManapandClaude Opus 5.5
2026-09-28 14:47:55 +02:00
-
a764cfacbc
Find the PostgreSQL a machine has, rather than assume its names

Ilker ManapandClaude Opus 5.5
2026-09-28 14:47:55 +02:00
-
2e0465f10a
Describe v0.8.7
v0.8.7

Ilker ManapandClaude Opus 5.5
2026-09-28 14:35:28 +02:00
-
cba65f5be7
Move a control plane to PostgreSQL with server init --postgres

Ilker ManapandClaude Opus 5.5
2026-09-28 14:33:03 +02:00
-
6dba6bd93a
Run a control plane when there is nothing else to run

Ilker ManapandClaude Opus 5.5
2026-09-28 13:06:29 +02:00
-
40c3d83110
Describe v0.8.6
v0.8.6

Ilker ManapandClaude Opus 5.5
2026-09-28 12:55:46 +02:00
-
069d334652
Ship Caddy and nginx configurations for the client port

Ilker ManapandClaude Opus 5.5
2026-09-28 12:55:46 +02:00
-
4865a96ec2
Describe v0.8.5
v0.8.5

Ilker ManapandClaude Opus 5.5
2026-09-28 12:44:32 +02:00
-
2a381ad669
Set up a control plane with one command

Ilker ManapandClaude Opus 5.5
2026-09-28 12:44:27 +02:00
-
746d4852af
Describe v0.8.4
v0.8.4

Ilker ManapandClaude Opus 5.5
2026-09-28 12:27:47 +02:00
-
33e678ab84
Show a node's logs on the admin page

Ilker ManapandClaude Opus 5.5
2026-09-28 12:27:47 +02:00
-
a821a05840
Describe v0.8.3
v0.8.3

Ilker ManapandClaude Opus 5.5
2026-09-28 12:14:22 +02:00
-
a40fc53e09
Wait for a new machine's own apt, and retry a failed install sooner

Ilker ManapandClaude Opus 5.5
2026-09-28 12:14:22 +02:00
-
8097a5616d
Describe v0.8.2
v0.8.2

Ilker ManapandClaude Opus 5.5
2026-09-28 11:50:12 +02:00
-
f5d6210b86
Install engines on any glibc system, with its own package manager

Ilker ManapandClaude Opus 5.5
2026-09-28 11:10:06 +02:00
-
7d97c6b74f
Install a node's engines on the node, instead of trusting what is there

Ilker ManapandClaude Opus 5.5
2026-09-28 10:59:59 +02:00
-
fa7f90880d
Put the changelog on the release page

Ilker ManapandClaude Opus 5.5
2026-09-28 10:32:58 +02:00
-
f90daa1ee9
Describe v0.8.1
v0.8.1

Ilker ManapandClaude Opus 5.5
2026-09-28 10:22:23 +02:00
-
20deb22dfa
Let a node describe itself instead of being described by hand

Ilker ManapandClaude Opus 5.5
2026-09-28 10:13:42 +02:00
-
2cae92d113
Offer a model that loads on demand in the chat picker

Ilker ManapandClaude Opus 5.5
2026-09-28 10:13:42 +02:00
-
b56130ace3
Link the usage report from the cluster page

Ilker ManapandClaude Opus 5
2026-09-28 08:12:38 +02:00
-
07809490e3
Show usage over time, per organization, team, project and person

Ilker ManapandClaude Opus 5
2026-09-28 08:11:31 +02:00
-
f80eef9fa6
Stop the chat page asking for more tokens than the model allows

Ilker ManapandClaude Opus 5
2026-09-28 00:48:07 +02:00
-
c848b2c73a
Offer a model once in the chat picker, not once per name

Ilker ManapandClaude Opus 5
2026-09-28 00:24:16 +02:00
-
4535bf362f
Price a request by the model that serves it

Ilker ManapandClaude Opus 5
2026-09-28 00:15:40 +02:00
-
d8fb198aa5
Make the install guide describe the system that exists

Ilker ManapandClaude Opus 5
2026-09-28 00:01:39 +02:00
-
03e38e7dda
Carry the profile fingerprint to the agent and back

Ilker ManapandClaude Opus 5
2026-09-27 23:22:44 +02:00
-
40f5c930c4
Say when a replica is running an edited profile, and check a source from the web too

Ilker ManapandClaude Opus 5
2026-09-27 22:42:26 +02:00
-
832d0a652c
Say when a budget cannot be spent against

Ilker ManapandClaude Opus 5
2026-09-27 21:56:56 +02:00
-
dfbb7557dd
Serve a model made of several files

Ilker ManapandClaude Opus 5
2026-09-27 21:07:26 +02:00
-
c95cfbe426
Keep a year of metrics, and watch the disk they share with the models

Ilker ManapandClaude Opus 5
2026-09-27 18:57:06 +02:00