get-set-fetch/scraper

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

5 best points · 1 comments · 1 Hacker News post · 112 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Plugin Based, Batteries Included, Web Scraper (5 points, 1 comments, by a1sabau, 2021-01-20)