Nowadays there are lot of hosting providers who offer cheap and fast service.
In the same way,I would suggest you to visit 9CubeHosting.com .Here they have three types of Linux based dedicated hosting plans.Each dedicated server comes with an OS of your choice and full root access to the server. This way, you can set up any software you require. You can also make use of a user-friendly Hosting Control Panel (the free Hepsia Control Panel, cPanel, DirectAdmin) installation option. Our optional backup, 3rd party software installation and troubleshooting services will cover all the admin tasks for you..Recently i hosted my own site using this service.I never had any problem with their services.So only i recommend this one. I hope it will be very useful to you.