Exactly same for me. Plus first time you do it thinking it will be fine, not only can it remove the black from the number (time to get the Sharpie out and a steady hand) but also smears the black ink onto the white of the reel, which then means super careful cleaning to remove the smear without messing up more numbers!

So now I always try a tiny bit with initially just a fresh soft micro-fibre and super light touch. If no loss of paint, I move up to krud kutter, or Novus 2, but always very very carefully!