pushkarparanjpe/web2db

Fetch webpage full-text, persist link and full text to SQLITE3 db, resumable with tqdm progressbar.

3 best points · 0 comments · 1 Hacker News post · 13 GitHub stars · View on GitHub

Hacker News discussions

• Web2db: Python lib to dump full text webpages to a sqlite3 DB file (3 points, 0 comments, by pX0r, 2020-02-13)