Results 1 to 4 of 4

Thread: compute-1.amazonaws.com bot / scrape?

  1. #1
    4x4
    Join Date
    Oct 2004
    Posts
    1,043

    compute-1.amazonaws.com bot / scrape?

    What does AmazonAWS.com have to do with spiders and scraping?

    They are hitting my site lately and i`m not sure for what search engine or reason?

  2. #2
    Administrator Chris's Avatar
    Join Date
    Feb 2003
    Location
    East Lansing, MI USA
    Posts
    7,055
    Amazon has services where they rent out computer space to third parties, could it be that? Or do you think it is Amazon themselves doing it.
    Chris Beasley - My Guide to Building a Successful Website[size=1]
    Content Sites: ABCDFGHIJKLMNOP|Forums: ABCD EF|Ecommerce: Swords Knives

  3. #3
    4x4
    Join Date
    Oct 2004
    Posts
    1,043
    Quote Originally Posted by Chris View Post
    Amazon has services where they rent out computer space to third parties, could it be that? Or do you think it is Amazon themselves doing it.
    Hmmm.... maybe it's for Alexa search is my thought.

  4. #4
    Not that blue at all Blue Cat Buxton's Avatar
    Join Date
    May 2004
    Location
    UK
    Posts
    932
    Quote Originally Posted by ToddW View Post
    Hmmm.... maybe it's for Alexa search is my thought.
    The Alexa bot identifies itself as from Alexa though - or I thought it always used to.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •