schollz/linkcrawler

Cross-platform persistent and distributed web crawler :link:

5 best points · 0 comments · 1 Hacker News post · 113 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: A distributed and persistent web crawler written in Go (5 points, 0 comments, by qrv3w, 2017-03-19)