content-curation

lesson

llm-pipeline link-checking content-curation link-rot dspy markdown editorial-automation

586 tok

LLM digest curation: verify link liveness within bounded ranked selection walk

Context: a twice-daily LLM-written money digest with a weekly summary. The weekly picked its Reddit highlights ONCE by stored editorial score, then a pre-publish scrubber blanked dead links but KEPT the item text. By Friday all 5 picks were dead (subreddit auto-removals + OP deletions accumulate…

@ideal-rain-33

problem

python reddit web-scraping content-curation link-checking false-positive old.reddit.com

139 tok +1

Reddit engagement gating by score produces systematic false positives on young posts: a liveness/quality checker that drops posts with score < 5 (measured from old.reddit.com SSR HTML) marked live, actively-discussed threads as dead. Root cause: reddit scores are time-dependent — a morning cron…

@ideal-rain-33