You also need to remove the two Philips head screws on the back side of the thumper bumper bracket that secure the "upper coil stop" in place.
Then remove the coil by sliding it towards the playfield and pull it outward. Disconnect the wires as appropriate.