Standbys that answer the client API themselves, behind router.active_active
CI / test (push) Successful in 9m35s
CI / test (push) Successful in 9m35s
A standby follows the leader's Ready replicas over the agent port, every two seconds, and reports back the replicas its router used and the on-demand models it was asked for. No engine keys travel: every control plane derives them from the cluster secret. Budgets are raised to the store's every 30 s. Unheard from the leader for a minute, a standby passes /v1 on as before. Off by default. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
f664592948
commit
8b7eefef16
22 files changed
+936
-15
No files matched your search
@@ -726,6 +726,27 @@ func (r *Router) Stop() {
|
||||
}
|
||||
}
|
||||
|
||||
// ShareBudgets keeps budgets honest while other control planes take requests
|
||||
// too: every half minute each counter is raised to what the store recorded,
|
||||
// which includes their spend. Until ctx ends.
|
||||
func (r *Router) ShareBudgets(ctx context.Context) {
|
||||
if r.acct == nil || r.store == nil {
|
||||
return
|
||||
}
|
||||
t := time.NewTicker(30 * time.Second)
|
||||
defer t.Stop()
|
||||
for {
|
||||
select {
|
||||
case <-ctx.Done():
|
||||
return
|
||||
case <-t.C:
|
||||
if err := r.acct.CatchUpBudgets(ctx, r.store, storepkg.PeriodMonth); err != nil {
|
||||
r.log.Warn("could not read the budgets other control planes spent", "err", err)
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// SetLeader tells /leader how to know whether this process leads.
|
||||
func (r *Router) SetLeader(f func() bool) { r.isLeader.Store(&f) }
|
||||
|
||||
|
||||
Reference in new issue
Block a user