I don't know that I hate the voice. I do know I hate most of the things he says.

There are actually some legal problems you can run into with voice impersonation. Particularly if you are doing it to bypass securing rights from a particular celebrity entity.

It's the actors that can possibly sue for impersonating them. Not AMC.
It's a very muddy thing. You can probably get away with impersonating a voice interpretation (an actor changing his voice to play a character). When you fake an actor's normal speaking voice, you are more likely to run into problems.

It might not even be the issue.
Someone from a design standpoint might have seriously thought it was a good idea to slay random zombies alongside a faceless redneck.