Err QOS... Packet shaping.. Bandwidth priorities can be set so that your VOIP traffic is main priority meaning that someone can browse your website (Albeit a tad slower) and your calls will be fine, considering you wont be on the phone 24/7 the problems stated dont seem to be too harsh.
Also people seem to be very anti home webservers - Not everyone has massive sites, some only have text and very small photos/images - considering that buttons, etc are cached then only dynamic sites may have a problem... considering the size of most content though you can hold a good few users without affecting your internet experience.
It isnt as bad as made out by some people - Theory from practise is alot different and this is coming from someone running a home webserver/IM server...
I can still play my games with around 20 people iming (my userbase/clan) such as EVE-Online with no problems on 2mbit...
Give it a go and see how it works for you