Crawlora-org/crawlora-deadweb
Is a domain genuinely dead, or just blocking your bot? A passive, local, MIT Go CLI + library that classifies domain reachability (alive/redirect/blocked/dead). The open methodology behind the Crawlora Dead-Web Index.
2 best points · 0 comments · 1 Hacker News post · 1 GitHub stars · View on GitHub
Hacker News discussions
- Show HN: crawlora-deadweb – 14% of the web is dead (2 points, 0 comments, by tonywangcn, 2026-06-19)