-
9fc098fd5b
Start llama.cpp with the model's own chat template

Ilker ManapandClaude Opus 5
2026-09-16 21:20:55 +02:00
-
c174e46902
Read the filename from a path comment inside the block

Ilker ManapandClaude Opus 5
2026-09-16 21:12:00 +02:00
-
45d0dee470
Let a reply full of code be downloaded as a zip

Ilker ManapandClaude Opus 5
2026-09-16 21:06:07 +02:00
-
0a98d01361
Say when a chat reply was cut off, and stop cutting it so early

Ilker ManapandClaude Opus 5
2026-09-16 21:03:07 +02:00
-
634f87ba15
Provision nodes with the host CPU model

Ilker ManapandClaude Opus 5
2026-09-16 20:42:48 +02:00
-
8a894af1ca
Let a profile say which nodes it is for

Ilker ManapandClaude Opus 5
2026-09-16 19:36:10 +02:00
-
aa4da3264d
Make adding a node one command, and check the engine actually runs

Ilker ManapandClaude Opus 5
2026-09-16 19:07:56 +02:00
-
082d52bc97
Stop shipping a placeholder that looks like a value, and say what is served

Ilker ManapandClaude Opus 5
2026-09-16 18:23:19 +02:00
-
6f3bde099e
Let a multi-node replica be adopted one agent at a time

Ilker ManapandClaude Opus 5
2026-09-16 17:15:00 +02:00
-
72b03a1a1c
Say which model is simulated instead of letting it look broken

Ilker ManapandClaude Opus 5
2026-09-16 17:11:56 +02:00
-
cbf276a41b
Render maths in the chat, without letting the model write markup

Ilker ManapandClaude Opus 5
2026-09-16 17:03:46 +02:00
-
3b67b1fe42
Stop the dashboard linking to pages that are not where it is

Ilker ManapandClaude Opus 5
2026-09-16 16:57:58 +02:00
-
f68fbf7c49
Check llmgw's engine flags against real vLLM and llama.cpp

Ilker ManapandClaude Opus 5
2026-09-16 16:52:11 +02:00
-
5b425c32e5
Ship binaries with releases, and ask engines whether our flags still exist

Ilker ManapandClaude Opus 5
2026-09-16 16:44:29 +02:00
-
7b4acd9284
A replica missing a shard is not ready

Ilker ManapandClaude Opus 5
2026-09-16 12:43:51 +02:00
-
c97b671ef9
Prove the multi-node path on a simulated cluster

Ilker ManapandClaude Opus 5
2026-09-16 12:34:23 +02:00
-
c1ac2f022f
Onboard a node with a script, and find two examples that never worked

Ilker ManapandClaude Opus 5
2026-09-16 12:28:36 +02:00
-
a075ff4120
Add approximate prefix routing, and find out it did nothing

Ilker ManapandClaude Opus 5
2026-09-16 12:13:19 +02:00
-
de21649ad6
Add an in-browser chat, without putting a key in the browser

Ilker ManapandClaude Opus 5
2026-09-16 12:05:30 +02:00
-
859f08da9b
Approve accounts from the browser, and draw the traffic

Ilker ManapandClaude Opus 5
2026-09-16 12:01:42 +02:00
-
e519dc587c
Serve the cluster dashboard over the web, without serving pprof with it

Ilker ManapandClaude Opus 5
2026-09-16 10:46:45 +02:00
-
058ee382fa
An agent reporting nothing is reporting something

Ilker ManapandClaude Opus 5
2026-09-16 10:36:35 +02:00
-
aef1c143c5
Let go of shards an agent says it is not running

Ilker ManapandClaude Opus 5
2026-09-16 10:30:49 +02:00
-
555e4678cb
Ship the systemd units, and stop the plan lying about what is done

Ilker ManapandClaude Opus 5
2026-09-16 10:04:44 +02:00
-
378383dd69
Align the bench table, which a tabwriter cannot

Ilker ManapandClaude Opus 5
2026-09-16 09:59:55 +02:00
-
5c837c531b
Pin down where CPU replicas land, and where they deliberately do not

Ilker ManapandClaude Opus 5
2026-09-16 09:57:12 +02:00
-
8a062fec35
Stop reusing replica ids, and stop handing out ports strays still hold

Ilker ManapandClaude Opus 5
2026-09-16 09:54:57 +02:00
-
05bdc7d6d4
Add ctl bench, and fix two holes it walked into

Ilker ManapandClaude Opus 5
2026-09-16 09:51:37 +02:00
-
ec943f9587
Stop a one-in-sixty-two test from failing once in a while

Ilker ManapandClaude Opus 5
2026-09-16 09:42:20 +02:00
-
79e459d9ff
Let people change their own password, and operators reset a lost one

Ilker ManapandClaude Opus 5
2026-09-16 09:39:11 +02:00
-
216fc9bb03
Let people sign up, be approved, and issue their own keys

Ilker ManapandClaude Opus 5
2026-09-16 09:32:35 +02:00
-
8d35faf6f8
Give the landing page somewhere to send people

Ilker ManapandClaude Opus 5
2026-09-16 09:22:42 +02:00
-
3ed211b2f4
Onboard users with one-time links instead of pasted keys

Ilker ManapandClaude Opus 5
2026-09-16 09:11:28 +02:00
-
cd3233ffe8
Do not leave the key store world-readable

Ilker ManapandClaude Opus 5
2026-09-16 09:01:41 +02:00
-
1839832b8b
Add a landing page and a read-only cluster dashboard

Ilker ManapandClaude Opus 5
2026-09-16 08:58:05 +02:00
-
0b93fb2883
Enforce budgets and rate limits, and write usage off the request path

Ilker ManapandClaude Opus 5
2026-09-16 08:52:36 +02:00
-
45c8cd23a3
Close the gateway: API keys, tenancy and model allowlists

Ilker ManapandClaude Opus 5
2026-09-16 08:44:33 +02:00
-
29617f8cb1
Add the store: tenancy, keys and usage on SQLite

Ilker ManapandClaude Opus 5
2026-09-16 08:37:40 +02:00
-
41cf894c72
Tick the phase 1 and 1.5 boxes their releases already earned

Ilker ManapandClaude Opus 5
2026-09-16 08:27:03 +02:00
-
f84e3b642a
Record the llama.cpp work in the plan and changelog

Ilker ManapandClaude Opus 5
2026-09-16 08:19:55 +02:00
-
f19db242ae
Stop naming a metric llama.cpp does not have, and say so when it happens

Ilker ManapandClaude Opus 5
2026-09-16 08:18:27 +02:00
-
501db3d3e8
Add the llama.cpp engine, and let a profile ask for no GPU

Ilker ManapandClaude Opus 5
2026-09-16 08:14:05 +02:00
-
ec1b6b04df
Fix an agent that could neither explain itself nor stop

Ilker ManapandClaude Opus 5
2026-09-16 08:03:21 +02:00
-
1e3cafdc86
Add a private CA and mutual TLS for the agent stream

Ilker ManapandClaude Opus 5
2026-09-16 07:28:56 +02:00
-
e8d90cf375
Treat a zombie as dead, and test fairness where it is deterministic

ilkerandClaude Opus 5
2026-09-16 06:32:59 +02:00
-
e1eb1d4149
Phase 3: ctl, and make draining a rolling move
v0.5.0

ilkerandClaude Opus 5
2026-09-16 06:27:21 +02:00
-
1d1a6aebb0
Phase 4: make a multi-node replica able to start

ilkerandClaude Opus 5
2026-09-16 06:20:03 +02:00
-
75a8e76706
Survive a control plane restart without orphaning live engines

ilkerandClaude Opus 5
2026-09-16 06:15:04 +02:00
-
40427b2705
plan: correct the store design and specify how tenancy is actually stored

ilkerandClaude Opus 5
2026-09-16 06:08:16 +02:00
-
2373726efd
Agent stream: connect the fleet to the control plane

ilkerandClaude Opus 5
2026-09-16 02:48:21 +02:00
-
c1b9ea1bc2
Phase 3 (3/3): wire the control plane to the router

ilkerandClaude Opus 5
2026-09-16 02:16:35 +02:00
-
f0134a2f95
Phase 3 (2/3): catalog and reconciler

ilkerandClaude Opus 5
2026-09-16 02:12:06 +02:00
-
06672d1b85
Phase 3 (1/3): cluster inventory and placement

ilkerandClaude Opus 5
2026-09-16 02:07:29 +02:00
-
55417546fc
Phase 2 (2/2): NVML backend behind a build tag

ilkerandClaude Opus 5
2026-09-16 02:05:25 +02:00
-
6a13e3dddf
Phase 2 (1/2): node discovery, engine adapters, process supervisor

ilkerandClaude Opus 5
2026-09-16 02:01:59 +02:00
-
dc38dd6096
Phase 1.5: admission control
v0.3.0

ilkerandClaude Opus 5
2026-09-16 01:53:38 +02:00
-
a3f71aa5ee
Phase 1: the router serves traffic
v0.2.0

ilkerandClaude Opus 5
2026-09-16 01:41:13 +02:00
-
f0c1ca87f1
ci: set milestone due dates at noon UTC

ilkerandClaude Opus 5
2026-09-16 01:34:05 +02:00
-
40c884a50a
Add a changelog and map releases onto roadmap phases
v0.1.0

ilkerandClaude Opus 5
2026-09-16 01:29:41 +02:00
-
664c8e9126
ci: add workflow_dispatch and take the Go version from go.mod

ilkerandClaude Opus 5
2026-09-16 01:19:12 +02:00
-
28029eb43b
Switch the project language to English

ilkerandClaude Opus 5
2026-09-16 01:15:21 +02:00
-
b7417e1a69
Phase 1 (1/2): scheduler pipeline, endpoint registry, metric scraping

ilkerandClaude Opus 5
2026-09-16 01:15:21 +02:00
-
e07bc46c57
Faz 0: iskelet ve sim-engine

ilkerandClaude Opus 5
2026-09-16 01:00:03 +02:00