Basically, the website host will store your website pages, and when they are requested by somebody visiting your website the Host will send the the relevant page to them via their browser. Hosting companies are online 24/7 and therefore your website pages get served no matter what time they are requested. Hosts also offer many other services, typically including email management, FTP access, sub-domain Management etc etc.
Finding the right host all depends on what service you require from the host. Some free Hosting companies offer you free hosting but then add advertising on your pages or limit the service that you receive. Personally I don't recommend Free Hosting Companies, but they may do what you require.
I use MyClubWeb.co.uk to host all my websites and to host all my clients websites. MyClubWeb have a reasonable pricing structure and they offer the right services for me, along with offering all of their clients fast quality support 24 hours a day, 7 days a week
Taking a closer look at all of MyClubWeb.co.uk's web hosting plans will help you evaluate their features and decide which package is the right one for you.
If you are just starting out on this journey of webmastery, I would recommend the Business package as it is the cheapest to get you started. If you require extra services you can always add them at any time in the future.
Again, selecting a hosting company is your choice, but here are a few links for you to check out.