I don't think that's a rivet, but rather a small nail that holds the metal foil against the wooden siderail. Undoubtedly the hole is a bit worn and is now too large. I would pry it out, and stick a bit of tooth-pick or other small wooden shim into the hole, and then put the nail back in. Should be easy enough to do without scratches.