Results 1 to 9 of 9

Thread: Is it necessary to use Robots.txt file?

  1. #1
    Study Abroad Consultancy newsheadlines's Avatar
    Join Date
    Jan 2017
    Location
    New Delhi
    Posts
    25

    Is it necessary to use Robots.txt file?

    Hello friends- Is it necessary to use Robots.txt file? It can be affect on website ranking in search engine.

  2. #2

  3. #3
    Registered
    Join Date
    Feb 2018
    Location
    US
    Posts
    381
    Do you know the use of Robots.txt file?
    It is a file by which you can give instructions to SE crawlers that which webpages of website are to index and which not to index.
    so Yes, it is an important part of SEO and you should not skip it.

  4. #4
    Registered
    Join Date
    Jul 2017
    Location
    Surat
    Posts
    187
    Agreed with John-Smith.
    Robots.txt file contains instructions which are required. if you don't upload a robots.txt file, Crawler will index all the web pages of your website each time. So You should add robots.txt File.

  5. #5
    Registered hubjohn's Avatar
    Join Date
    Jan 2018
    Location
    Singapore
    Posts
    22
    Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.

  6. #6
    Registered
    Join Date
    Feb 2018
    Location
    US
    Posts
    381
    I hope your doubt is cleared with the above answers.
    in case you have any doubt left, ask it.!

    Quote Originally Posted by newsheadlines View Post
    Hello friends- Is it necessary to use Robots.txt file? It can be affect on website ranking in search engine.

  7. #7
    Registered RH-Calvin's Avatar
    Join Date
    Mar 2017
    Location
    Forum
    Posts
    1,667
    Yes robots.txt is necessary for your website. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
    Cheap VPS Hosting | VPS Starting from $12 PER Year
    Cheap Dedicated Server | Unmetered Bandwidth | Free Setup and IPMI

  8. #8
    Registered evejones's Avatar
    Join Date
    Nov 2017
    Posts
    201
    Quote Originally Posted by newsheadlines View Post
    Hello friends- Is it necessary to use Robots.txt file? It can be affect on website ranking in search engine.
    A person associated with SEO knows the value of robots.txt file and I'm sure you dont know about SEO at all.

  9. #9
    Registered
    Join Date
    Jun 2017
    Posts
    314
    Quote Originally Posted by newsheadlines View Post
    Hello friends- Is it necessary to use Robots.txt file? It can be affect on website ranking in search engine.
    Tell me what you already know about robots.txt?

Similar Threads

  1. What is Robots Text File
    By Nexevo Technologi in forum Search Engine Optimization
    Replies: 11
    Last Post: 08-01-2017, 05:14 AM
  2. How to Create the Robots txt file.
    By Nexevo Technologi in forum Search Engine Optimization
    Replies: 2
    Last Post: 03-16-2016, 03:55 AM
  3. How to add the robots txt file in weebly blog
    By Nexevo Technologi in forum Search Engine Optimization
    Replies: 0
    Last Post: 01-18-2016, 07:34 AM
  4. Is Google ignoring my robots.txt file?
    By flyingpylon in forum Search Engine Optimization
    Replies: 9
    Last Post: 01-13-2004, 09:47 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •