jcpeterson/openwebtext

Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.

3 best points · 0 comments · 2 Hacker News posts · 768 GitHub stars · View on GitHub

Hacker News discussions

• OpenWebText: Clone of OpenAI's Unreleased WebText Dataset Scraper (3 points, 0 comments, by ArtWomb, 2019-02-28)
• OpenWebText: Open Clone of OpenAI's GPT-2 WebText Dataset (2 points, 0 comments, by joshuacpeterson, 2019-02-28)