Go to
http://portableapps.com/ and install the suite onto a USB pen you will see one of the apps is Thunderbird portable which should do what you want.
There is also a portable version of Firefox and the good thing about these apps is they work directly from the pen and don't install anything on the PC you are using it on plus it doesn't leave any history on the PC either it is all confined to the USB pen.