yeah I would say its something to expect on VM broadband, the average reported by samknows is 4-8ms.
On my VM line since a 2nd upstream channel got enabled (doubled previous upstream capacity) my jitter is about 2-5ms at dusk and mornings but still goes up to 10-20ms at peak. I do see occasional sub 2ms jitter VM lines but they seem extremely rare. Incidently the last one I seen was from a VM staff member on here which raises questions how his own service is on a rare upstream so low utilised :p
However for what its worth 5ms or so of jitter is nothing of real concern, using ssh on my line is generally fine now, when at 20ms or so the jitter is noticeble if I look for it but not enough to interrupt what I am doing. For gaming I expect 5ms is also fine, the real issues is when get silly random high ping spikes.
Just checked ssh right now and it feels barely different from my adsl line at 1ms. But does get occasional bits of small lag if I hold a key down and watch it. However is ok, I am not fussy for the sake of it, when I was kicking up a fuss I had silly very high jitter.