Ilker ManapandClaude Opus 5.5 94eec557ad Serve a model from an external OpenAI-compatible provider ...

A catalog model with external {url, model, api_key_file} and no profiles
is published as an endpoint by the control plane, the key read from its
file each time; the router rewrites the request's model to the provider's
name and sends its key. It is never scraped nor stale, and nothing is
placed for it. Named in fallbacks, it serves when the cluster has no room.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-09-30 23:29:01 +02:00

..

endpoint_test.go

Track which replicas are actually being used, and summarise the fleet

2026-09-17 00:52:34 +02:00

endpoint.go

Serve a model from an external OpenAI-compatible provider

2026-09-30 23:29:01 +02:00