I've written a reasonably verbose tutorial about setting up your own server.
Many hosts haven't switched to PHP 5.3 yet, and you often want more control anyway, so here's a way to create your own server for £7.50 a month.
http://thomasedwards.co.uk/article/ubuntu-amp-web-server
Donate
