Hey, swampfire, sounds to me like you handled it pretty calmly in any case. You explained the situation intelligently but his head was too far up his ass to listen. So don't let it get you down.
If I was in your place and the guy didn't want me playing his games anymore, what I'd probably done is pull that fistful of tokens out of my pocket and say to him: "You want to refund these, then? 'Cause otherwise I'm not leaving until they're all played off."
But that's just me (perhaps more so in my younger days than now)...