I started out replacing all the connectors, then realized that was dumb, they get discolored, but rarely have damage. So if you have the extraction tool, then you just have to repin and it's cheaper. The extraction tool is about $15 if i remember, which sucks, sometimes i think you can get away with a small pick, but this is definitely a case of the right tool for the job is worth it. Just be careful as it can break fairly easily. I've broken mine once already and had to recreate it, by grinding it down into the correct shape again.
I just mark the connector with a "x" so i know that i repined it.