You're plugging it into the wrong audio input then, if the audio is only there when you're on a different AV channel.
You need to connect the red & white phono plugs into whichever audio input on the TV is associated with the DVI input. It may actually be the small 3.5mm socket, which would require a cheapo adaptor (
Maplin has them).