PDA

View Full Version : Explain Spiders, Robots, and Crawlers



rscomponentseo
07-02-2019, 02:09 AM
Explain Spiders, Robots, and Crawlers

Rscomp
07-02-2019, 08:47 PM
Spiders, robot and crawler, they are all the same and referred by different names. It is a software program that follows or “Crawls” various links throughout the internet, and then grabs the content from the sites and adds to the search engine indexes.

PoolMaster
07-02-2019, 10:57 PM
Spider and crawler are technically the same, except that spider is used mainly for a tool used to crawl the website, while crawler is used for search engines (also crawling the website).

RH-Calvin
07-03-2019, 10:18 PM
They are all the same and are search engine programs that read through webpage sources and provide information to search engines.

imriakapoor
07-03-2019, 10:26 PM
Are you going to do any special RnD after we define all of these?

MVMinfotech18
07-03-2019, 10:44 PM
According to my opinion Robots, spider and crawlers, Both are the same. they work for the same purpose means collecting content and sending for indexing.

John-Smith
07-03-2019, 11:02 PM
You should use Google to get the definitions! Google will explain in detail or you can use wiki.