I don't know the first one, as it was in my grandparents basement was I was VERY young (maybe 3-4) and it barely worked. None of my family remember the name or what it looked like.
First arcade style game (besides the pinball above) that I DO remember would be the Williams Double Play pitch and bat that is still down in that basement. Been in their home since Dec 65. Grandma still has the receipt for it.