Ilker Manap and Claude Opus 5.5
3a3db8cd20
Answers to similar questions, not only the same one
...
llmgw keys cache --similar 0.95 also gives a chat question the answer to
one like it: the last user message embedded by router.cache.embedding_model
(asked on the gateway's account, as a judge is, within 2 s), compared by
cosine with the questions answered in the same conversation — system
prompt, earlier turns, tools and sampling the same. The exact cache is
asked first; an exact hit embeds nothing. Said as x-llmgw-cache: similar
with x-llmgw-cache-similarity, charged as a hit.
The vectors live with their answers in the gateway's memory, counted in
max_bytes and evicted with them, not in a pgvector table as BACKLOG I1
planned: the cache keeps answer text out of the store on purpose. A
question over 2,000 characters is reused only when the same. Migration
0051 holds the setting. BACKLOG I1.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-25 17:47:11 +01:00
..
2026-10-10 16:11:09 +02:00
2026-09-16 01:15:21 +02:00
2026-10-25 17:01:30 +01:00
2026-10-05 01:21:11 +02:00
2026-10-05 01:21:11 +02:00
2026-10-10 18:30:52 +02:00
2026-10-25 17:01:30 +01:00
2026-10-09 21:15:50 +02:00
2026-10-17 08:56:30 +02:00
2026-10-05 01:14:38 +02:00
2026-10-08 21:30:50 +02:00
2026-09-17 18:12:10 +02:00
2026-10-05 01:21:11 +02:00
2026-10-04 10:02:44 +02:00
2026-10-04 10:02:44 +02:00
2026-09-30 00:29:52 +02:00
2026-09-30 00:29:52 +02:00
2026-10-04 22:56:25 +02:00
2026-10-04 21:00:01 +02:00
2026-10-04 21:00:01 +02:00
2026-10-10 23:53:33 +02:00
2026-10-09 11:43:21 +02:00
2026-10-25 17:47:11 +01:00
2026-10-25 17:47:11 +01:00
2026-10-04 23:50:53 +02:00
2026-10-04 19:56:16 +02:00
2026-10-14 13:55:34 +02:00
2026-09-28 20:52:31 +02:00
2026-09-28 20:52:31 +02:00
2026-10-08 15:59:23 +02:00
2026-10-11 16:10:22 +02:00
2026-10-04 23:03:35 +02:00
2026-10-11 20:45:06 +02:00
2026-09-16 23:07:49 +02:00
2026-10-19 12:55:27 +02:00
2026-10-19 12:55:27 +02:00
2026-10-04 23:46:42 +02:00
2026-10-17 08:56:30 +02:00
2026-10-05 01:21:30 +02:00
2026-10-05 01:21:30 +02:00
2026-10-15 07:24:59 +02:00
2026-10-10 16:11:09 +02:00
2026-10-16 10:27:50 +02:00
2026-10-06 12:41:08 +02:00
2026-10-04 15:11:50 +02:00
2026-10-25 17:15:48 +01:00
2026-10-03 22:29:12 +02:00
2026-10-03 18:57:50 +02:00
2026-10-10 19:16:20 +02:00
2026-10-14 13:55:34 +02:00
2026-10-14 10:06:20 +02:00
2026-10-11 16:10:22 +02:00
2026-10-14 10:06:20 +02:00
2026-10-16 10:27:50 +02:00
2026-10-08 13:43:47 +02:00
2026-10-08 15:42:40 +02:00
2026-10-08 15:42:40 +02:00
2026-10-05 01:27:14 +02:00
2026-10-05 01:21:11 +02:00
2026-10-05 00:12:53 +02:00
2026-10-11 16:28:40 +02:00
2026-10-11 16:28:40 +02:00
2026-10-05 01:14:38 +02:00
2026-10-05 01:14:38 +02:00
2026-10-20 23:00:22 +02:00
2026-10-20 23:00:22 +02:00
2026-10-15 07:24:59 +02:00
2026-10-15 07:24:59 +02:00
2026-10-20 10:53:24 +02:00
2026-10-14 01:12:47 +02:00
2026-10-14 13:55:34 +02:00
2026-10-14 11:05:02 +02:00
2026-10-14 11:05:02 +02:00
2026-10-25 17:47:11 +01:00
2026-10-04 23:03:35 +02:00
2026-10-10 18:46:44 +02:00
2026-10-10 20:22:48 +02:00
2026-10-03 19:55:24 +02:00
2026-10-05 00:04:43 +02:00
2026-10-09 18:03:00 +02:00
2026-10-11 20:45:06 +02:00
2026-10-04 22:51:21 +02:00
2026-10-04 23:50:53 +02:00
2026-10-04 23:27:31 +02:00
2026-10-04 12:20:24 +02:00
2026-10-04 22:56:25 +02:00
2026-10-25 16:41:53 +01:00
2026-10-25 16:41:53 +01:00
2026-09-30 04:00:35 +02:00
2026-10-16 08:35:28 +02:00
2026-10-25 17:47:11 +01:00
2026-10-25 17:47:11 +01:00
2026-10-25 17:47:11 +01:00
2026-10-04 19:45:37 +02:00
2026-10-10 22:25:27 +02:00
2026-10-04 19:45:37 +02:00
2026-10-04 10:49:10 +02:00
2026-09-27 08:09:49 +02:00
2026-10-11 20:45:06 +02:00
2026-10-04 23:13:18 +02:00
2026-10-04 23:13:18 +02:00
2026-10-25 12:59:20 +01:00
2026-10-25 12:59:20 +01:00
2026-10-11 14:28:15 +02:00
2026-10-14 13:55:34 +02:00