100% agree with previous two posts - leave it as is (and it looks pretty good as-is btw - your flaking is minor). Not worth even the minor damage you can do wiping it down. You will kick yourself 1 second after you see even 1 flake come off.

For cleaning it, less is more approach.

Ps - if you are taping over the score and credit windows before sealing, make sure that tape doesn't touch the edge of the ink as it will want to take it with when you go to remove the tape after sealing. Ideally, you want a tiny bit of clear to enter the score window edge to seal the ink around it.