Guess what can leak tooEither way batteries are evil! PGMs often die from the same problem. Supercaps make me feel more at ease.
I never remove the rechargeable coin cells on MVS boards, unless they're actual duds. More of than not they just need a good charge to work. Although if you're not powering them on often, they will go flat eventually. In this case a regular battery is better.