Huh. I haven’t been called a schmuck since junior high; and that was a friend. Of course nobody calls a burly mechanic with a breaker bar in hand a schmuck and survives the same way. Buuut...that’s just me.
I’d just back hand him and wait for the tears. Or compliment his cannon balls for saying it to your face. That takes guts.