those covers are tricky to remove without breaking one or both slots. Don't worry if you do, if the relay is okay (which I doubt) you should be able to pop it back on, and even then it's not vital. I've seen relays without their covers on and the relay has still worked fine.

also replacing the relay itself can prove tricky in the sense of removing all the solder without pulling out the through hole plating.