The female voice complexity requires more male brain power to comprehend in men than a male voice would. The female voice triggers a different part of the brain to a male part, making the man form mental images of the person speaking. As a result men tire of the female voice.
http://abc.net.au/science/news/healt...sh_1428081.htm