postmodern/spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

1 best points · 0 comments · 1 Hacker News post · 836 GitHub stars · View on GitHub

Hacker News discussions

• Spidr: A versatile Ruby web spidering library (1 points, 0 comments, by vyuh, 2017-02-06)