Ilker ManapandClaude Opus 5.5 8ffde2b80c A big model's download no longer runs out its startup timeout ...

The startup timeout runs from when a node's download last moved, so a
model of hundreds of gigabytes on a slow mirror is not failed while it
arrives. ctl model serve --env sets engine variables (NCCL_DEBUG=INFO)
on every node, and a layout given by hand keeps expert parallelism for a
model of experts. docs/large-models.md: how a model is split, what each
way needs of a card, and a checklist for bringing one up on a fabric.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

2026-10-20 09:45:31 +02:00

..

canary_test.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

canary.go

An embedding model is served for embedding, with many slots

2026-10-14 09:19:57 +02:00

gate_test.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

gate.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

modelserve_test.go

A big model's download no longer runs out its startup timeout

2026-10-20 09:45:31 +02:00

modelserve.go

A big model's download no longer runs out its startup timeout

2026-10-20 09:45:31 +02:00

plan.go

A big model's download no longer runs out its startup timeout

2026-10-20 09:45:31 +02:00

slots_test.go

serve: tool calls declared, slots that hold the context, longer answers

2026-10-05 09:30:40 +02:00

trace_test.go

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

trace.go

Tracing beyond the router: reconcile passes, placement and a replica's start traced down to the node

2026-10-05 00:03:17 +02:00

updates_test.go

Quality suites, and new weights held to one: ctl eval, model update/promote --eval, model gate

2026-10-05 00:04:43 +02:00

updates.go

An embedding model is served for embedding, with many slots

2026-10-14 09:19:57 +02:00