When washing only use a very small amount of detergent (they are not realy dirty - you just want to refresh them) and do not let them dry for too long.
Softener just makes them water resistant
(not too good for drying off with then)
Try this with one towel first, see if that is better.