I think this is auto-complete that is causing this. On your bank website press CTRL and SHIFT and DELETE tick all the boxes and restart your browser
You may need to go into the settings of Internet Explorer and disable auto-complete. This can be done by going to the settings cog at the top right, then internet options, then content and under autocomplete click on settings.
Click the 'clear history button' and restart IE.