binux/pyspider

A Powerful Spider(Web Crawler) System in Python.

159 best points · 40 comments · 1 Hacker News post · 16,745 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: A Python Spider System with Web UI (159 points, 40 comments, by binux, 2014-11-17)