From 3a3535b31087203c3e3f4c4e87492c619be4375b Mon Sep 17 00:00:00 2001 From: Ilker Manap Date: Thu, 8 Oct 2026 15:12:17 +0200 Subject: [PATCH] Backlog: knowledge bases tried on the PoC, and what it showed Co-Authored-By: Claude Opus 5.5 (1M context) --- BACKLOG.md | 21 ++++++++++++++++++--- 1 file changed, 18 insertions(+), 3 deletions(-) diff --git a/BACKLOG.md b/BACKLOG.md index 73e8d41..17ab563 100644 --- a/BACKLOG.md +++ b/BACKLOG.md @@ -923,8 +923,22 @@ screen, `docs/knowledge.md`; CI builds the client for all six targets and releases attach it. Tested: every format from generated fixtures and a Turkish PDF (OCR path with Tesseract here), sync against a fake gateway and end to end against the router on pgvector. -Left: never run against the PoC (needs pgvector there and an embedding -model in the catalog); no LibreOffice on the dev machine, so the legacy +Tried on the PoC 2026-10-08 (control planes 140 and 150 on a dev build of +this branch; their previous binary is /usr/local/bin/llmgw.pre-rag): Ubuntu's +pgvector 0.6.0 installed on 149/150 and enabled; bge-m3's weights were never +in the mirror (fetched from CompendiumLabs/bge-m3-gguf@1864f47f) and it is +held at 1 replica; tree Demo/ik/belgeler and Demo/satis/crm with a key each; +collection Demo/politikalar filled from a Mac through an SSH tunnel with ten +Turkish files in nine formats (9 sent in 5 s, the .doc skipped for want of +LibreOffice; a rerun sent nothing in 0 s; a changed file alone was sent). +Nine Turkish questions each found their page first once search scored by +similarity plus word coverage (rank fusion had got two wrong). The other +team's key saw no collection and got 404 by id; with a read grant it read +and could not write; revoked, nothing again. On the live store the llmgw +role (not superuser, no BYPASSRLS) sees 0 chunks with no scope set and 0 +with the organization alone. +Left: the gateway's collection list shows the owner as team:ID, not its +path; no LibreOffice on the dev machine, so the legacy Office path is untested beyond its error; the client is unsigned (Gatekeeper and SmartScreen warn); Outlook `.msg` is not read; one document over ~60 MiB of JSON (a few thousand pages) is refused rather than split. @@ -939,7 +953,8 @@ at a time, or a router test loses its rows mid-run. add up down the tree. Personal keys and sessions need `x-llmgw-project` (or the playground's picker) naming a scope the person is a member of. - A collection not allowed answers 404, exactly as a missing one. -- Hybrid search with the filter inside the query (`hnsw.iterative_scan`, +- Hybrid search with the filter inside the query (per collection, its own + partial index; pgvector 0.6 is enough — `WHERE org_id = $1 AND collection = ANY($2)`), full-text arm merged by reciprocal rank, `/v1/rerank` when a reranker is in the catalog. Top chunks into a system message with document and position;