How to develop a search engine. how to connect all websites on my webpag.

Question

To develop a search engine and connect database. I have already designed a search page but i am confuse

Answer 1

You will need web crawlers. Or bots that goes from webpage to webpage looking for links.

Here is a link to wiki post-
https://en.m.wikipedia.org/wiki/Web_crawler

Answer 2

The core of a search engine is a reverse index. A search engine is like a database with "two table columns -query and content." So you need to create . Your server must be huge enough to rank millions of results otherwise you can't beat Google. Your target may not be to beat Google. You may want to create a search engine for particular task like searching through Kindle books or sth like that. Your algorithm must be smart enough to return the most relevant result. This is where Google has outsmarted other search engine. You have somewhere to start. You can check open source web crawlers online to get a glimpse of what you should expect. Good luck!