What server are you running? Depending on your host, you might not be able to install Joomla, as it requires quite a lot of fiddling. I'm lucky as I've got a dedicated machine, but I know that if I was using shared hosting, I wouldn't have a hope in hell!
If you want to experiment with the system, try their online demo (
http://demo.joomla.org/administrator).