Ilker ManapandClaude Opus 5.5 e40b9ac202 Load LoRA adapters at scale zero ...

--lora with --lora-init-without-apply leaves an adapter's scale at 1,
and llama-server applies it at that scale to any request without a
"lora" list of its own: every plain request for the model was served
with its adapters on. Found live on qwen2.5-coder-7b-instruct. Each
adapter is now loaded with --lora-scaled FILE:0.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-01 07:39:12 +02:00

..

admission

Displace the newest lowest-band request when the gateway queue is full

2026-09-30 23:07:53 +02:00

breaker

Phase 1 (1/2): scheduler pipeline, endpoint registry, metric scraping

2026-09-16 01:15:21 +02:00

endpoint

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

prefix

Add approximate prefix routing, and find out it did nothing

2026-09-16 12:13:19 +02:00

proxy

Follow one request from its id to the replica that served it

2026-09-30 02:36:45 +02:00

scheduler

Spill a saturated pool's requests to the next pool

2026-09-30 23:23:32 +02:00

scrape

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

activate.go

Park a model that fails every time it starts, and say so everywhere

2026-09-30 01:21:57 +02:00

adapter_test.go

Serve LoRA adapters on llama.cpp models, asked for by name

2026-09-30 23:40:47 +02:00

admin_test.go

Give metrics a door that does not also open onto pprof

2026-09-17 18:12:10 +02:00

admin.go

Give metrics a door that does not also open onto pprof

2026-09-17 18:12:10 +02:00

adminguard_test.go

Stop a browser page, or a model definition, from running code on the nodes

2026-09-30 00:29:52 +02:00

adminguard.go

Stop a browser page, or a model definition, from running code on the nodes

2026-09-30 00:29:52 +02:00

budget_fallback.go

Price a request by the model that serves it

2026-09-28 00:15:40 +02:00

chat_load_test.go

Show a model loading in the chat, and send once it is up

2026-09-28 20:52:31 +02:00

chat_load.go

Show a model loading in the chat, and send once it is up

2026-09-28 20:52:31 +02:00

chat_models_test.go

Let the chat be stopped, timed, tuned and kept across a reload

2026-09-29 09:54:23 +02:00

chat.go

Let the chat be stopped, timed, tuned and kept across a reload

2026-09-29 09:54:23 +02:00

context_limit_test.go

Know how big a model's context is, and what it can do

2026-09-16 23:07:49 +02:00

context_limit.go

Know how big a model's context is, and what it can do

2026-09-16 23:07:49 +02:00

external_test.go

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00

finish_test.go

Displace the newest lowest-band request when the gateway queue is full

2026-09-30 23:07:53 +02:00

handlers.go

Load LoRA adapters at scale zero

2026-10-01 07:39:12 +02:00

memory.go

agenta memory eklendi

2026-09-24 04:04:03 +03:00

metrics.go

Close what a second security review found still open

2026-09-30 02:25:07 +02:00

pages_auth_test.go

Connect an editor from the account page, and serve the Responses API

2026-09-29 10:04:17 +02:00

pricing_test.go

Follow one request from its id to the replica that served it

2026-09-30 02:36:45 +02:00

responses_test.go

Connect an editor from the account page, and serve the Responses API

2026-09-29 10:04:17 +02:00

responses.go

Connect an editor from the account page, and serve the Responses API

2026-09-29 10:04:17 +02:00

router_listen_test.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

router_test.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

router.go

Serve LoRA adapters on llama.cpp models, asked for by name

2026-09-30 23:40:47 +02:00

threads_test.go

Stop the text-search comment naming one language

2026-09-27 08:09:49 +02:00

threads.go

Let a person belong to many places, or to none

2026-09-28 19:03:46 +02:00

trace_test.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00

trace.go

Release v0.10.4: CPU threads, tracing, and the rest of the review

2026-09-30 04:00:35 +02:00