ilker pushed tag v0.14.7 to ilker/llmgw 2026-10-16 20:11:28 +02:00
ilker pushed to main at ilker/llmgw 2026-10-16 20:11:27 +02:00
af942aca27 v0.14.7: changelog and README
ilker pushed to main at ilker/llmgw 2026-10-16 19:35:49 +02:00
3e7dd20bad One machine runs one judge, on up to four cores
ilker pushed to main at ilker/llmgw 2026-10-16 19:22:40 +02:00
f8206c3540 A judge reserves two cores and 2 GB, with no prompt cache
ilker pushed to main at ilker/llmgw 2026-10-16 18:15:59 +02:00
0def6eaba1 CI: run on maas-packer, the runner that serves this Gitea, given 8 cores and 32 GB
ilker pushed to main at ilker/llmgw 2026-10-16 17:49:45 +02:00
645be2d278 CI: run again on the runner given 8 cores and 32 GB
ilker pushed to main at ilker/llmgw 2026-10-16 16:54:49 +02:00
25c4ec9f2a CI: a package that hangs says which test it hung in
ilker pushed tag v0.14.6 to ilker/llmgw 2026-10-16 13:33:15 +02:00
ilker pushed to main at ilker/llmgw 2026-10-16 13:33:15 +02:00
7eb50c5eb6 v0.14.6: changelog and README
ilker pushed to main at ilker/llmgw 2026-10-16 13:29:22 +02:00
b8fc1de822 Backlog I: what other gateways do that llmgw does not
ilker pushed to main at ilker/llmgw 2026-10-16 13:00:49 +02:00
63b2c6d9a4 The judges and the starter divide a machine's CPUs instead of each taking all
ilker pushed to main at ilker/llmgw 2026-10-16 11:01:52 +02:00
0b984a92bc A judge is asked again only on another machine
bc4c5d5ac9 A judge replica that hangs is overtaken by another at half the budget
Compare 2 commits »
ilker pushed to main at ilker/llmgw 2026-10-15 23:19:01 +02:00
b09922b29b Leadership stays put while the store's primary is replaced
ilker pushed to main at ilker/llmgw 2026-10-15 20:48:14 +02:00
5a4b022dcd A lost store machine is given up on in seconds, and a new leader waits for its judge
ilker pushed to main at ilker/llmgw 2026-10-15 17:35:18 +02:00
eeaffd764d A floating address keeps to its own network, and Caddy follows the leader
ilker pushed to main at ilker/llmgw 2026-10-15 11:22:41 +02:00
94401e21e6 Setup lets every part be chosen, each with its settings; three machines each run the gateway
ilker pushed to main at ilker/llmgw 2026-10-15 08:09:40 +02:00
733e20924c Merge remote-tracking branch 'origin/mcp-wait' into sd-dedupe
fc60481e40 Every control plane lists the others alike to Prometheus
edeeb9f8e1 MCP takes pictures of real size, by id too, and waits for a cold model
Compare 3 commits »
ilker created branch mcp-wait in ilker/llmgw 2026-10-15 07:25:05 +02:00
ilker pushed to mcp-wait at ilker/llmgw 2026-10-15 07:25:05 +02:00
edeeb9f8e1 MCP takes pictures of real size, by id too, and waits for a cold model
ilker pushed to main at ilker/llmgw 2026-10-15 00:22:02 +02:00
c22528c26e A model that does not fit its card is not added to fail; weights in use are not removed