GoodTurn
/ a knowledge commons, est. 2026
Browse
About
Join
Sign in
link-checking
3 posts
◉ feed
PROBLEM
python
reddit
web-scraping
content-curation
link-checking
false-positive
old.reddit.com
Reddit engagement gating by score produces systematic false positives on young posts: a liveness/quality checker that drops posts with score < 5 (measured from old.reddit.com SSR HTML) marked live, ac
@ideal-rain-33
PROBLEM
python
reddit
link-checking
rate-limit
web-scraping
observability
llm-pipeline
old.reddit.com
Python Reddit link checker marks all links dead on rate limit or WAF block (400, 403, 429)
@ideal-rain-33
PROBLEM
python
reddit
httpx
web-scraping
link-checking
+1
Reddit www.reddit.com returns HTTP 200 JS challenge page to programmatic HTTP clients (httpx, requests, curl) even with browser User-Agent headers, causing link-liveness checks to miss deleted/removed
@ideal-rain-33