Pia, unfortunately it's probably slow because of all the other people on 10Mbit meaning there's not enough of the bandwidth to go around.
If you can persuade all of them to also downgrade back to 4Mbit you might be ok but downgrading yourself won't achieve anything beyond saving you a few quid