This website requires JavaScript.
Explore
Help
Sign In
ilker
/
llmgw
Watch
2
Star
0
Fork
1
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
95
Wiki
Activity
Files
c19abe95e1e08dae213eaa4521bd248e5033f6cd
llmgw
/
internal
/
router
T
History
Ilker Manap
and
Claude Opus 5.5
36cdbce125
Release / build (push)
Successful in 4m26s
Details
Release / notes (push)
Successful in 3s
Details
CI / test (push)
Successful in 5m14s
Details
Merge ha: replicated store, second control plane, join codes, setup and console screens
...
Co-Authored-By: Claude Opus 5.5 (1M context) <
noreply@anthropic.com
>
2026-10-03 22:59:49 +02:00
..
admission
Displace the newest lowest-band request when the gateway queue is full
2026-09-30 23:07:53 +02:00
breaker
Phase 1 (1/2): scheduler pipeline, endpoint registry, metric scraping
2026-09-16 01:15:21 +02:00
endpoint
Serve a model from an external OpenAI-compatible provider
2026-09-30 23:29:01 +02:00
prefix
Add approximate prefix routing, and find out it did nothing
2026-09-16 12:13:19 +02:00
proxy
Follow one request from its id to the replica that served it
2026-09-30 02:36:45 +02:00
scheduler
Spill a saturated pool's requests to the next pool
2026-09-30 23:23:32 +02:00
scrape
Serve a model from an external OpenAI-compatible provider
2026-09-30 23:29:01 +02:00
activate.go
Park a model that fails every time it starts, and say so everywhere
2026-09-30 01:21:57 +02:00
adapter_test.go
Serve LoRA adapters on llama.cpp models, asked for by name
2026-09-30 23:40:47 +02:00
admin_test.go
Give metrics a door that does not also open onto pprof
2026-09-17 18:12:10 +02:00
admin.go
Give metrics a door that does not also open onto pprof
2026-09-17 18:12:10 +02:00
adminguard_test.go
Stop a browser page, or a model definition, from running code on the nodes
2026-09-30 00:29:52 +02:00
adminguard.go
Stop a browser page, or a model definition, from running code on the nodes
2026-09-30 00:29:52 +02:00
budget_fallback.go
Price a request by the model that serves it
2026-09-28 00:15:40 +02:00
chat_load_test.go
Show a model loading in the chat, and send once it is up
2026-09-28 20:52:31 +02:00
chat_load.go
Show a model loading in the chat, and send once it is up
2026-09-28 20:52:31 +02:00
chat_models_test.go
Let the chat be stopped, timed, tuned and kept across a reload
2026-09-29 09:54:23 +02:00
chat.go
Say on the chat page whether a GPU or a CPU answered
2026-10-03 18:57:50 +02:00
context_limit_test.go
Know how big a model's context is, and what it can do
2026-09-16 23:07:49 +02:00
context_limit.go
Know how big a model's context is, and what it can do
2026-09-16 23:07:49 +02:00
external_test.go
Serve a model from an external OpenAI-compatible provider
2026-09-30 23:29:01 +02:00
finish_test.go
Displace the newest lowest-band request when the gateway queue is full
2026-09-30 23:07:53 +02:00
handlers.go
Merge ha: replicated store, second control plane, join codes, setup and console screens
2026-10-03 22:59:49 +02:00
hardware_leader_test.go
Add a standby control plane with server add, and draw the screens as windows
2026-10-03 22:29:12 +02:00
hardware_test.go
Say on the chat page whether a GPU or a CPU answered
2026-10-03 18:57:50 +02:00
memory.go
agenta memory eklendi
2026-09-24 04:04:03 +03:00
metrics.go
Publish per-tenant request and budget series, and alert on them
2026-10-03 19:55:24 +02:00
pages_auth_test.go
Connect an editor from the account page, and serve the Responses API
2026-09-29 10:04:17 +02:00
pricing_test.go
Publish per-tenant request and budget series, and alert on them
2026-10-03 19:55:24 +02:00
responses_test.go
Connect an editor from the account page, and serve the Responses API
2026-09-29 10:04:17 +02:00
responses.go
Connect an editor from the account page, and serve the Responses API
2026-09-29 10:04:17 +02:00
router_listen_test.go
Release v0.10.4: CPU threads, tracing, and the rest of the review
2026-09-30 04:00:35 +02:00
router_test.go
Release v0.10.4: CPU threads, tracing, and the rest of the review
2026-09-30 04:00:35 +02:00
router.go
Merge ha: replicated store, second control plane, join codes, setup and console screens
2026-10-03 22:59:49 +02:00
tenantmetrics.go
Publish per-tenant request and budget series, and alert on them
2026-10-03 19:55:24 +02:00
threads_test.go
Stop the text-search comment naming one language
2026-09-27 08:09:49 +02:00
threads.go
Let a person belong to many places, or to none
2026-09-28 19:03:46 +02:00
trace_test.go
Release v0.10.4: CPU threads, tracing, and the rest of the review
2026-09-30 04:00:35 +02:00
trace.go
Release v0.10.4: CPU threads, tracing, and the rest of the review
2026-09-30 04:00:35 +02:00