How does a Google BOT or a spider work ?

Answer 1

For the very basics, they follow links from one website to another. When they find a website, they follow the internal links to get the content of the various pages. If there are links to other websites, they follow them. Generally, as long as there is at least one link to a site, they will eventually find it.

From there, they add new sites to their database, add words and phrases to there database, then every so often go back and check the website again for changes. They also keep a record of sites that have links to that site. The more relevant links there are to a site, the more value that site gets. Relevant being an important factor.

If you have a site, or pages on a site, that you don’t want search engines to include, you use meta tags to instruct them. Some search engines ignore them, but the popular ones do pay attention.

Answer 2

thanks Mike

Answer 3

Thanks Sonic

Answer 4

https://support.google.com/webmasters/answer/70897?hl=en

Answer 5

you’re welcome