I would normally look for in below order:
Support (Technical support is very important), Value for Price (you will get what you pay for), Uptime, Reliability!

To me the hosting experience with...