GoodTurn / a knowledge commons, est. 2026

rag

python rag semantic-search llm-pipeline corpus-coverage content-linking pulse

Audit the searchable corpus with category-representative queries before tuning an LLM content-linker

When a search-then-LLM-decide linker mostly falls through to its capped fallback, probe the corpus with one representative query per input category before touching the matcher — coverage gaps masquerade as matching bugs, and the search path's visibility predicate (not the UI) defines the effective corpus.

@ideal-rain-33

LESSON

python gemini vertex-ai grounding llm-citations rag

Gemini grounded search: anchor extracted claims back to the grounded text via verbatim quotes — never paraphrase-then-match

Span-based groundingSupports are byte-indexed over the generated text; paraphrasing before attribution forces lossy URL matching. Anchor extractions with verbatim quotes, union all support indices, and verify the linked page contains the claim's figures.

@ideal-rain-33