llmgw

768 Commits 9 Branches 95 Tags

3 Commits

Include renames

Author	SHA1	Message	Date
Ilker ManapandClaude Opus 5	c1ac2f022f	Onboard a node with a script, and find two examples that never worked New nodes had been joined by hand, four times, by me. There was no procedure, so there was nothing to be wrong — and nothing to be right either. Two scripts now: provision-node.sh makes the VM on Proxmox, onboard-node.sh gives it an identity. They are separate because they are run by different people with different access, and the second must run where the certificate authority is, which is the one part that cannot be delegated. Running them turned up why phase 4 was never verified. FabricAttachment carried no koanf tags, so the `name:` key the shipped example documents bound to nothing and `rate_gbps` was never read at all. An agent configured exactly as instructed refused to start with "fabrics[0]: name is required" — naming the key the operator had just written. Every fabric in this project had been configured in a Go test, where the tags do not matter. The server example did not load either: its models had no source, so it failed validation the moment anything tried to parse it. Both examples are now parsed by a test. A published example that has never been loaded is a guess, and these two had been guesses since they were written. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>	2026-09-16 12:28:36 +02:00
ilkerandClaude Opus 5	28029eb43b	Switch the project language to English CI / test (push) Has been cancelled Details Comments, doc comments, test names, error and log messages, CLI help, README, Makefile, CI step names and the design document are now all in English. No behaviour changes; the full suite passes under the race detector. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>	2026-09-16 01:15:21 +02:00
ilkerandClaude Opus 5	e07bc46c57	Faz 0: iskelet ve sim-engine CI / test (push) Has been cancelled Details Plan v0.2'nin Faz 0 çıktısı. Yazılan sıraya göre: - cobra tabanlı CLI iskeleti; server/agent/ctl komutları henüz stub. - internal/sim: OpenAI uyumlu sahte inference engine. Router'ı GPU olmadan gerçekçi koşullarda test edebilmek için gerçek bir engine'in router açısından önemli davranışlarını modeller: * continuous batching ve KV blok muhasebesi (head-of-line blocking dahil) * zincirlenmiş blok hash'leri + LRU ile otomatik prefix cache * batch büyüdükçe artan token gecikmesi * istemci koptuğunda isteğin düşürülüp blokların bırakılması * vLLM metrik adlarıyla /metrics (plan §7.6 engine kontratı) - Testler: prefix hash zincirlemesi, LRU tahliyesi, iptal propagasyonu, kuyruklama, SSE formatı, usage/cached_tokens, metriklerin gerçek Prometheus parser'ıyla okunabilirliği. - Gitea Actions CI: gofmt, vet, race detector. Modül yolu gitea.mynodes.xyz/ilker/llmgw; `make rename` ile değiştirilebilir. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>	2026-09-16 01:00:03 +02:00

Author

SHA1

Message

Date

Ilker ManapandClaude Opus 5

c1ac2f022f

Onboard a node with a script, and find two examples that never worked

New nodes had been joined by hand, four times, by me. There was no procedure,
so there was nothing to be wrong — and nothing to be right either. Two scripts
now: provision-node.sh makes the VM on Proxmox, onboard-node.sh gives it an
identity. They are separate because they are run by different people with
different access, and the second must run where the certificate authority is,
which is the one part that cannot be delegated.

Running them turned up why phase 4 was never verified. FabricAttachment
carried no koanf tags, so the `name:` key the shipped example documents bound
to nothing and `rate_gbps` was never read at all. An agent configured exactly
as instructed refused to start with "fabrics[0]: name is required" — naming
the key the operator had just written. Every fabric in this project had been
configured in a Go test, where the tags do not matter.

The server example did not load either: its models had no source, so it failed
validation the moment anything tried to parse it.

Both examples are now parsed by a test. A published example that has never
been loaded is a guess, and these two had been guesses since they were
written.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-16 12:28:36 +02:00

ilkerandClaude Opus 5

28029eb43b

Switch the project language to English

CI / test (push) Has been cancelled

Details

Comments, doc comments, test names, error and log messages, CLI help, README,
Makefile, CI step names and the design document are now all in English.
No behaviour changes; the full suite passes under the race detector.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-16 01:15:21 +02:00

ilkerandClaude Opus 5

e07bc46c57

Faz 0: iskelet ve sim-engine

CI / test (push) Has been cancelled

Details

Plan v0.2'nin Faz 0 çıktısı. Yazılan sıraya göre:

- cobra tabanlı CLI iskeleti; server/agent/ctl komutları henüz stub.
- internal/sim: OpenAI uyumlu sahte inference engine. Router'ı GPU olmadan
  gerçekçi koşullarda test edebilmek için gerçek bir engine'in router
  açısından önemli davranışlarını modeller:
    * continuous batching ve KV blok muhasebesi (head-of-line blocking dahil)
    * zincirlenmiş blok hash'leri + LRU ile otomatik prefix cache
    * batch büyüdükçe artan token gecikmesi
    * istemci koptuğunda isteğin düşürülüp blokların bırakılması
    * vLLM metrik adlarıyla /metrics (plan §7.6 engine kontratı)
- Testler: prefix hash zincirlemesi, LRU tahliyesi, iptal propagasyonu,
  kuyruklama, SSE formatı, usage/cached_tokens, metriklerin gerçek
  Prometheus parser'ıyla okunabilirliği.
- Gitea Actions CI: gofmt, vet, race detector.

Modül yolu gitea.mynodes.xyz/ilker/llmgw; `make rename` ile değiştirilebilir.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-16 01:00:03 +02:00