internetarchive/sandcrawler

Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki

2 best points · 0 comments · 1 Hacker News post · 28 GitHub stars · View on GitHub

Hacker News discussions

• SeaweedFS S3 performance test, with comparison to Minio (2 points, 0 comments, by chrislusf, 2020-10-02)