PDA

View Full Version : what is web crawlers?



nikilkumar
07-26-2017, 10:51 PM
what is web crawlers?

naksh
07-27-2017, 10:11 PM
Web crawlers or spiders are software programs which are designed to crawl, index, rank and return webpages to users.

neelseowork
07-27-2017, 10:40 PM
what is web crawlers?

A web crawler also known as a web spider or web robot is a program or automated script which browses the World Wide Web in a methodical, automated manner. This process is called Web crawling or spidering. Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.

Nas
07-28-2017, 05:20 AM
A web crawler (also known as a web spider or search engine robot) is a programmed script that browses the World Wide Web in a methodical, automatic manner. This process is called as web crawling or spidering. ... Moreover, the spiders or crawlers are used for automating maintenance tasks on the web site.

jackar56
07-31-2017, 05:11 AM
Web crawlers are spiders or bots that crawls your websites in detail to rank them on search engine. Every search engine has it's own crawler.

RH-Calvin
08-02-2017, 11:38 PM
Web crawler is a search engine automated program that is responsible to read through webpage source and provide information to search engines. They are known as spiders, crawlers and robots.

crackersguru
08-03-2017, 09:29 PM
Web crawler is a program that acts as an automated script which browses through the internet in a systematic way. The web crawler looks at the keywords in the pages, the kind of content each page has and the links, before returning the information to the search engine.