The common element between the start failures and the lack of a game over is the "On Ball Release" switches. If those two switches are not closing, you'll see both those issues. Check the switches attached to the ball gate in the ball trough. When that gate falls (after points are scored on ball 1), both switches should close - which then enables end of game detection and the replay switch.
BTW, correct operation is - after points are scored on ball 1, pressing the replay switch will start a new game.