amazon sites

[Snowballer]

Hi,

Is it a general consensus that its better to pull all the amazon items you want and store them on the server as oppose to pulling items on the fly?

If someone out there pulls items on the fly, does amazon keep up during a searchengine spider?

My feeling is that having the data locally will make the site that much more responsive.

[James]

You're not allowed to pull items more than 1 per second, I believe.

[r2d2]

No, thats true. I had thought about writing some kind of script to store product details in a database. But everyone seems to just grab them on the fly, or sometimes use a cache, but to cache the HTML output of a page request rather than product details in a database.

[Snowballer]

Don't you find that sites that pull from amazon live are a bit slow?

If you have 1000's of products, i'm sure you go over the 1 second rule hehe. I guess they are not that strict about it.

[moonshield]

Don't you find that sites that pull from amazon live are a bit slow?

Nope, I find them to be quite swift. It does matter if your server is up to par.

[r2d2]

Also AWS4 seems faster than AWS3.

[Blue Cat Buxton]

The one second rule is per request to their server; some searches will pull 10 results, but that is why you need caching to avoid repeat server requests

[r2d2]

A search with 10 results is still only one request though.. Or weren't you saying that?

[James]

Sounds like she was saying that.

[Blue Cat Buxton]

I was (or at least trying too)