A cached prompt costs the cached rate
cached_per_1k in a price charges the prompt tokens the answer counts as cached_tokens at their own rate; zero keeps charging them as prompt tokens. The count reaches the cost and not a column: CostMicros holds what it changed. Cached beyond the prompt is clamped, an engine's miscount rather than a refund. BACKLOG L5. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
73e1bb6733
commit
ed0d1ec0ad
12 files changed
+85
-11
No files matched your search
@@ -503,6 +503,10 @@ type Personal struct {
|
||||
type Price struct {
|
||||
PromptPer1k int64 `koanf:"prompt_per_1k"`
|
||||
CompletionPer1k int64 `koanf:"completion_per_1k"`
|
||||
// CachedPer1k is the cost of a prompt token the engine or provider read
|
||||
// from its cache (the answer's cached_tokens, counted within the
|
||||
// prompt's). Zero charges them at prompt_per_1k.
|
||||
CachedPer1k int64 `koanf:"cached_per_1k"`
|
||||
// PerImage is the cost of one picture, for a model that makes them
|
||||
// (/v1/images/generations), on top of its prompt's tokens.
|
||||
PerImage int64 `koanf:"per_image"`
|
||||
|
||||
Reference in new issue
Block a user