If you are positive that it's not Second Player relay that Mark mentioned. Then I would look at score motor 2C. It might be occasionally missing a pulse. Eliminate that and you'll probably want to look at your P2 Player Unit switches.
Use jumper wires to close any suspect switches.