PDA

View Full Version : Robots.txt



AndyH
08-26-2004, 01:08 AM
I am linking out of my AWS site using an out script.


User-agent: *
Disallow: /link/

Links are like this: www.example.com/link/out.php?ASIN=XXXX

Will that work fine - just want to be sure.

Here is the out.php script if you want to use it, very basic but someone might need it:


<?

$ASIN = $_GET["ASIN"];

header("Location: http://www.amazon.com/exec/obidos/ASIN/$ASIN/ASSOCIATE_ID/102-5485018-9998560?dev-t=DEV_ID&camp=2025&link_code=xm2");

?>

stymiee
12-29-2004, 09:01 PM
It should work in terms of allow your visitors to follow the link. If you wish to prevent spiders from following those links that should be effective for that goal as well. Now the only problem I can forsee is, for Google, you are passing quite a bit of PR to a page it can't index.

Blue Cat Buxton
12-30-2004, 02:19 AM
It should work in terms of allow your visitors to follow the link. If you wish to prevent spiders from following those links that should be effective for that goal as well. Now the only problem I can forsee is, for Google, you are passing quite a bit of PR to a page it can't index.

I thought that if Google couldnt see a page ie throug robot exclusion it didnt pass PR

stymiee
12-30-2004, 06:24 AM
Not 100% sure myself. Kinda hard to test. I would like that to be true though.

XtrEM3
01-29-2005, 01:55 PM
in out.php, u can remove the session-id

http://www.amazon.com/exec/obidos/ASIN/$ASIN/ASSOCIATE_ID?dev-t=DEV_ID&camp=2025&link_code=xm2