I've read the community wiki and some questions here on Ask Ubuntu about security measures on Ubuntu, but I would like to focus on the security of online money transactions.
Is a VPN service with SSL connection enough to make this kind of operation as secure as possible (even if using public wireless spots?)
I am counting on using a Live-USB with Firefox or Chrome browser, both the Live system and the browser used only and strictly for this delicate purpose, thus creating an independent system to take precautions against any potential malware that may have infiltrated my regular everyday system and browser and I'll also be using a secure connection. Any other security measures that I should be aware of?
+1 for the question which affects many of us. I can only say the following:
Even with today's technology and security measures there will always be a way to bypass them, be them an easy task or a difficult nearly impossible one. At the end, they can be done (See in google stuff like wikileaks, information leak, etc..). With this in mind I will add that having an SSL connection (Secure Socket Layer, although I am guessing a TLS 1.x will be used) is very secured. Even more in Ubuntu (Or any other Linux Distro) since, not only are the standards applied but they even get updated faster and with any new security measures.
Add to this that you will be using a VPN will give you even more security.
Having that, plus a secured OS like Ubuntu (Very secured since you are going to load it from a Live USB, which is like a Paranoid Security Level PSL) gives you a HUGE security measure over the PC you would be using. Of course the only downside is the connection to the place you would be connecting and the connection to it.
You can have a very secured system, but if the connection to the other end is compromised, it lowers your security. It lowers even more if where you are connecting has already been compromised.
So from what I can read from your question, the only 2 things left to think about would be:
This are questions that can help you when having a more secured way of connecting. Now a good question to ask yourself is:
I can give you an example of my father that uses Ubuntu + Firefox to connect to Bank of America and other 3 banks. He pays all bills, does transfers, payse credit card, etc.. This is like 3 years ago (Since he got Ubuntu ^^).