+ 3
How useful is scrapy?
Python short description of the usefulness of the scrapy module in python
1 Réponse
+ 7
Scrapy is a webcrawling framework. You can pretty easily get a webcrawler (webspider) running in it and set its parameters (rules of crawling, depth, sorts of websites, etc.)
After that you can run your spiders from the command line (shell). Just prepare some hard drive space for them! ;)