Quoted from cfh:
but they don’t leak. At least I have yet to see one leak, and I have installed hundreds of them (though I guess any battery can leak, but it’s so small, there’s limit stuff to leak).
I have seen coin batteries leak and it was very corrosive. They're not immune to it.