I guess with a business connection, they'll actually install the phone then
Seriously mate, if they've been charging you for a phone service they haven't even provided, you should be looking at a little more than just ending the contract.
I would have thought that they should be reimbursing you, for the entirety of the period you've been billed?