Results 1 to 3 of 3

Thread: robots.txt

  1. #1
    Registered
    Join Date
    May 2003
    Posts
    12

    robots.txt

    Hello there,

    I have urls like this:

    http://www.freizeitagentur.de/show_u...nickname=user1
    http://www.freizeitagentur.de/show_u...nickname=user2


    I tried to block it with robots.txt:

    Disallow: /show_user.php

    This doesn't really work. (because every url is unique?) Any other solutions?

  2. #2
    Administrator Chris's Avatar
    Join Date
    Feb 2003
    Location
    East Lansing, MI USA
    Posts
    7,055
    put show_user.php in a directory and then block the directory.

    Or, have show_user.php echo out a robots meta tag.
    Chris Beasley - My Guide to Building a Successful Website[size=1]
    Content Sites: ABCDFGHIJKLMNOP|Forums: ABCD EF|Ecommerce: Swords Knives

  3. #3
    Registered
    Join Date
    May 2003
    Posts
    12
    Thanks for your help, Chris.

    The first solution requires quite a lot of changes to the script.

    The second will still cause a lot of traffic.

    I think robots.txt is flexible enough at the moment.

Similar Threads

  1. Robots.txt
    By incka in forum Search Engine Optimization
    Replies: 2
    Last Post: 04-10-2004, 06:59 PM
  2. RewiredMind.com
    By KMxRetro in forum User Owned Websites
    Replies: 10
    Last Post: 01-17-2004, 12:55 PM
  3. Is Google ignoring my robots.txt file?
    By flyingpylon in forum Search Engine Optimization
    Replies: 9
    Last Post: 01-13-2004, 09:47 AM
  4. robots.txt?
    By Mike in forum Search Engine Optimization
    Replies: 11
    Last Post: 12-24-2003, 09:27 AM
  5. robots.txt question
    By Kyle in forum Search Engine Optimization
    Replies: 6
    Last Post: 11-04-2003, 03:13 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •