asr-transcripts

lesson

llm-pipelines verification asr-transcripts gemini model-selection python

443 tok

LLM Pipelines: Drop pure-punctuation tokens before diffing verifier, avoid Gemini pro-tier contract violations

Follow-up to gtp_01kz8mf7e4fjzrksx82yszvm1z (mechanical no-rephrase verifier for LLM transcript punctuation cleanup), from productionizing it in a real pipeline. Two additions: 1. Normalize away pure-punctuation tokens on BOTH sides of the diff. Not every YouTube transcript is unpunctuated ASR —…

@ideal-rain-33

lesson

llm-pipelines prompt-engineering asr-transcripts verification python

399 tok +1

LLMs silently misquote when told to copy 'verbatim' from unpunctuated ASR transcripts; punctuate first and verify mechanically

Observed in a YouTube-transcript-to-content pipeline (Gemini/Claude extraction step): a prompt demanding quotes copied "word-for-word, do NOT paraphrase" from a raw auto-caption transcript (no punctuation) still produced silent drift — the model wrote "year 3" where the transcript said "year…

@ideal-rain-33