llmgw/internal at d2c27e2c76c49f589180b7963643a160560d2c2d - llmgw - Gitea: Mynodes.xyz

ilker/llmgw

0 Fork 1

Files

T

History

Ilker ManapandClaude Opus 5.5 d2c27e2c76 Slurm: slurmd started as its unit expects, and slurmd's own stepd not a job

Found on the PoC (Ubuntu 24.04, Slurm 23.11.4): the packaged unit is
Type=notify, so slurmd needs --systemd or systemd times it out; and slurmd
keeps a 'slurmstepd infinity' for its cgroup v2 scope, which was counted as
a job and kept the node from llmgw.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-11 13:11:41 +01:00

..

People sign in with their Active Directory account

2026-10-18 10:59:50 +02:00

Rate limits counted across the control planes with router.active_active

2026-11-01 17:30:08 +01:00

Slurm: slurmd started as its unit expects, and slurmd's own stepd not a job

2026-11-11 13:11:41 +01:00

Standbys that answer the client API themselves, behind router.active_active

2026-11-01 13:47:47 +01:00

Requests missing the cache for the same key at once share one read and one allowance

2026-10-31 09:30:18 +01:00

ctl bench reads a guarded engine's metrics with the engine's key, or says why it cannot

2026-10-05 00:20:25 +02:00

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

Canary routing: a model's canary takes its share of requests, a session stays on one side, x-llmgw-variant pins one, and the two are compared

2026-10-04 19:56:16 +02:00

Slurm beside llmgw, P3 and P4: the leader hands nodes over; ctl slurm

2026-11-11 12:33:14 +01:00

Pictures, 3D models, a vision model and workflows as tools at /mcp

2026-10-14 13:11:09 +02:00

Believe X-Forwarded-* only from router.trusted_proxies

2026-10-04 10:29:02 +02:00

ComfyUI models of one environment share one replica

2026-10-14 13:55:34 +02:00

Slurm beside llmgw, P1: its settings and the files a controller runs on

2026-11-11 12:20:31 +01:00

Slurm beside llmgw, P3 and P4: the leader hands nodes over; ctl slurm

2026-11-11 12:33:14 +01:00

An organization's admin, and forms only for those who may send them

2026-11-08 11:38:06 +01:00

Slurm beside llmgw, P1: its settings and the files a controller runs on

2026-11-11 12:20:31 +01:00

A card in the wrong PCIe slot is said so

2026-10-29 08:49:16 +01:00

The firewall setting reaches the mirror machine and the store's members

2026-10-09 08:53:17 +02:00

How fast a model answers on the CPU, before it is served

2026-11-03 08:52:15 +01:00

Outside services read answers redacted and whole; a card's own lanes

2026-10-29 13:22:39 +01:00

A repository's files read from every directory, not only its top

2026-10-30 12:16:11 +01:00

Bound idle time, header size and request reading on every listener, and connections on the client port

2026-10-04 10:21:15 +02:00

The gateway embeds the documents llmgw-kb sends as text

2026-10-29 21:56:05 +01:00

Precise KV-index routing: vLLM KV cache events through the agent, routed by leading blocks held

2026-10-05 01:21:11 +02:00

A forgotten password is set through a one-time link

2026-10-07 13:20:11 +02:00

An MCP client for the company's tool servers

2026-10-20 10:43:35 +02:00

A mirror download cut off carries on from where it got to, and is tried again

2026-10-30 17:47:32 +01:00

The serve forms start at the longest context that fits

2026-11-08 14:38:41 +01:00

Several keys for one outside provider

2026-10-17 08:56:30 +02:00

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

A node's own readiness and its multi-node readiness are kept apart

2026-10-07 13:11:16 +02:00

A lost store machine is given up on in seconds, and a new leader waits for its judge

2026-10-15 20:33:13 +02:00

A machine too small for the models it would serve is said so first

2026-10-25 16:19:00 +01:00

Show usage over time, per organization, team, project and person

2026-09-28 08:11:31 +02:00

Offline sites and Kubernetes: llmgw bundle create, import and trust, offline.mirror, server init --bundle; a Helm chart for the control plane

2026-10-05 00:13:39 +02:00

Rate limits counted across the control planes with router.active_active

2026-11-01 17:30:08 +01:00

gofmt what the security work left unformatted

2026-10-04 12:22:51 +02:00

An organization's admin, and forms only for those who may send them

2026-11-08 11:38:06 +01:00

Sign-in is set up from the console, and a directory tried before it is kept

2026-10-19 12:55:27 +02:00

The cluster's settings live in the store, and every change takes effect

2026-10-05 15:25:23 +02:00

Onboard a node with a script, and find two examples that never worked

2026-09-16 12:28:36 +02:00

Slurm beside llmgw, P2: the agent keeps its node's part

2026-11-11 12:25:41 +01:00

Keep the control plane's fetches off link-local addresses, and see through NAT64, 6to4 and proxies

2026-10-04 10:48:01 +02:00

An organization's admin, and forms only for those who may send them

2026-11-08 11:38:06 +01:00

Strata's DeepSeek not offered on cards its engine was not built for, and refused there by the agent

2026-10-30 13:00:21 +01:00

Put etcd and Patroni's API on TLS, and move a running cluster there in maintenance mode

2026-10-04 12:07:17 +02:00

Switch the project language to English

2026-09-16 01:15:21 +02:00

VS Code's sign-in keeps its place; recordings checked for secrets

2026-10-29 11:40:19 +01:00

The serve forms start at the longest context that fits

2026-11-08 14:38:41 +01:00