How useful is scrapy?

Question

Python short description of the usefulness of the scrapy module in python

Answer 1

Scrapy is a webcrawling framework. You can pretty easily get a webcrawler (webspider) running in it and set its parameters (rules of crawling, depth, sorts of websites, etc.)
After that you can run your spiders from the command line (shell). Just prepare some hard drive space for them! ;)