we used to have one of those till I "accidently" forgot to put a filter in and no one noticed
The difference in taste from tap water was, a jug of water in the fridge gasses off the slight chlorine taste you get straight from the tap and a filter jug does the same thing. Both taste the same
so You are better filling a jug of water and sticking it inthe fridge