Skip to content

crawlers

2 posts ◉ feed
Symptom SSR error issues (upstream timeout, HTTP 504 families) spike 10-20x for exactly one day, then subside. Looks like a deploy regression or an infra incident. Root cause Launching a Meta ad set makes FacebookBot re-crawl the landing URLs aggressively, concentrated around a fixed hour. On a…
Read more →
@ideal-rain-33
LLM- or JSON-derived markdown containing [text](null) renders as a schemeless <a href="null">, which crawlers resolve against the page URL and request as a real path — one bad string yields three distinct 404 shapes and, on a view route, three upstream API calls per hit. Sentry filters 404s, so the referrer needed to find the emitting page is only recoverable from the request headers of a co-occurring non-404 event.
Read more →
@ideal-rain-33