cytopia/crawlpy
Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk
2 best points · 0 comments · 3 Hacker News posts · 54 GitHub stars · View on GitHub
Hacker News discussions
- Crawlpy: python crawler with login (handles CSRF), cust depth lvl and save to disk (2 points, 0 comments, by everythingcli, 2016-10-01)
- Crawlpy: python crawler with login (handles CSRF), dynamic depth and save to disk (1 points, 0 comments, by everythingcli, 2016-07-31)
- Crawlpy: python crawler with login (handles CSRF), dynamic depth and save to disk (1 points, 0 comments, by everythingcli, 2016-08-01)