clemlesne/scrape-it-now

Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.

81 best points · 31 comments · 1 Hacker News post · 542 GitHub stars · View on GitHub

Hacker News discussions

• A web scraping CLI made for AI that is idempotent (81 points, 31 comments, by clemlesne, 2024-08-16)