A fair question.
I feel like you lose when you didn't mean to start a 2 player game, and player 2 wins.
Or if yiu meant to start one, anytime during the first ball you feel like one player is "the good game," and that one loses
EDIT: only on my 3rd beer, so I'll figure it out in an hour or 2