Results 1 to 5 of 5

Thread: Robots.txt

  1. #1
    Senior Member AndyH's Avatar
    Join Date
    May 2004
    Location
    Australia
    Posts
    553

    Robots.txt

    I am linking out of my AWS site using an out script.

    Code:
    User-agent: *
    Disallow: /link/
    Links are like this: www.example.com/link/out.php?ASIN=XXXX

    Will that work fine - just want to be sure.

    Here is the out.php script if you want to use it, very basic but someone might need it:

    PHP Code:
    <?

    $ASIN 
    $_GET["ASIN"];

    header("Location: http://www.amazon.com/exec/obidos/ASIN/$ASIN/ASSOCIATE_ID/102-5485018-9998560?dev-t=DEV_ID&camp=2025&link_code=xm2");

    ?>
    New website released. ya rly!

  2. #2
    Site Contributor stymiee's Avatar
    Join Date
    Dec 2004
    Location
    Between the Pipes
    Posts
    275
    It should work in terms of allow your visitors to follow the link. If you wish to prevent spiders from following those links that should be effective for that goal as well. Now the only problem I can forsee is, for Google, you are passing quite a bit of PR to a page it can't index.
    John Conde :: brainyminds
    Merchant Account Services -- Merchant Services Resources
    IT'S HERE: Integrate the Authorize.net Payment Gateway with PHP
    Everything you need to integrate Authorize.net into your website with PHP. Includes an explanation of how transactions work, validating credit cards, and the source code for free.

  3. #3
    Not that blue at all Blue Cat Buxton's Avatar
    Join Date
    May 2004
    Location
    UK
    Posts
    932
    Quote Originally Posted by stymiee
    It should work in terms of allow your visitors to follow the link. If you wish to prevent spiders from following those links that should be effective for that goal as well. Now the only problem I can forsee is, for Google, you are passing quite a bit of PR to a page it can't index.
    I thought that if Google couldnt see a page ie throug robot exclusion it didnt pass PR

  4. #4
    Site Contributor stymiee's Avatar
    Join Date
    Dec 2004
    Location
    Between the Pipes
    Posts
    275
    Not 100% sure myself. Kinda hard to test. I would like that to be true though.
    John Conde :: brainyminds
    Merchant Account Services -- Merchant Services Resources
    IT'S HERE: Integrate the Authorize.net Payment Gateway with PHP
    Everything you need to integrate Authorize.net into your website with PHP. Includes an explanation of how transactions work, validating credit cards, and the source code for free.

  5. #5
    Registered
    Join Date
    Oct 2004
    Posts
    13
    in out.php, u can remove the session-id

    http://www.amazon.com/exec/obidos/ASIN/$ASIN/ASSOCIATE_ID?dev-t=DEV_ID&camp=2025&link_code=xm2

Similar Threads

  1. Robots.txt
    By incka in forum Search Engine Optimization
    Replies: 2
    Last Post: 04-10-2004, 06:59 PM
  2. robots.txt
    By delpino in forum Search Engine Optimization
    Replies: 2
    Last Post: 01-23-2004, 02:13 AM
  3. Is Google ignoring my robots.txt file?
    By flyingpylon in forum Search Engine Optimization
    Replies: 9
    Last Post: 01-13-2004, 09:47 AM
  4. robots.txt?
    By Mike in forum Search Engine Optimization
    Replies: 11
    Last Post: 12-24-2003, 09:27 AM
  5. robots.txt question
    By Kyle in forum Search Engine Optimization
    Replies: 6
    Last Post: 11-04-2003, 03:13 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •