Web-crawler

Question

is it possible to create a web crawler that is able to crawl the whole internet and gather information from only official websites??

Answer 1

I'm building a website and buying a domain is it possible that all that information gets stored on the server of the domain provider and I'll be relieved from spending huge amount of data... if it is possible will my web-crawler be able to crawl day and night on that sever???

Answer 2

All of the website hosting I’ve seen has some type of limit to how much data they can store. So while you could save it to your server, it would eventually (and probably quickly) fill up

Answer 3

is it possible that I can buy more space... on the server ??

Answer 4

You could buy more space, but nothing is infinite. Eventually you would run out of space. The internet is gigantic, and new websites are created every minute.

Answer 5

is there anything that can help me out in that case??

Answer 6

You can always manually create your own server. It is of course a lot harder than just using some service but you can control literally everything about it.