any4ai/AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

2 best points · 3 comments · 2 Hacker News posts · 3,511 GitHub stars · View on GitHub

Hacker News discussions

• Built an open-source web scraper for AI agents – seeking feedback (2 points, 3 comments, by ntbperst, 2025-06-01)
• Show HN: AnyCrawl v0.0.1-alpha.5 – custom user-agent and richer scraping API (2 points, 0 comments, by ntbperst, 2025-06-14)