looks like a fun project, if i was ever to create my own hardware id definitely go raspberry pi + fpga. Write the game in a nice high level language and get video/audio/networking/memory for free and leave the real time stuff to the fpga. (which is basically a P-Roc)
Definitely fun to create the hardware your self if you like all that low level stuff