Hello friends,
What is the main usage of search engine spiders?
Printable View
Hello friends,
What is the main usage of search engine spiders?
Google spiders are responsible to read through webpage source and provide information to search engines. They are responsible to provide cache certificate to webpages successfully crawled.
A spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "crawler" or a "bot." Spiders are typically programmed to visit sites that have been submitted by their owners as new or updated.
Spiders are used to fetch the billions web page all major search engine google,yahoo are used this spider these program work when search the web and travel to one hyper link to another link.
Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches.
A search engine spider is a program that works behind the scenes to deliver up-to-date Web search results to users through a search engine. The search engine spider can work continuously or respond to user events.