janreges/siteone-crawler

SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).

32 best points · 4 comments · 3 Hacker News posts · 998 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: SiteOne Crawler – in-depth website analyzer and exporter (open-source) (32 points, 2 comments, by janreges, 2024-08-19)
• Show HN: SiteOne Crawler – Single-binary CI/CD gate for web quality regressions (3 points, 2 comments, by janreges, 2026-03-17)
• Show HN: Turn Any Website into Clean Markdown for LLMs/RAG with SiteOne Crawler (2 points, 0 comments, by janreges, 2025-11-30)