I've noticed the same problems since getting the hub. Was using one of the old modems through a Netgear and pings were fine all day, last night I couldn't find a game on CoD due to my ping. Rebooting the router did fix this momentarily though, so could be a capacity issue...
Give Virgin a ring and show them these graphs, maybe they have an explanation?
Hope this helps