You have blown out the audio section of your IJ that you were running to the subwoofer. The speaker driver will be fine, the little amplifier will be fine, but your board is screwed. As others have mentioned, the cable you bought DOES NOT convert the signal from high level to low level.
What you did was run a high level signal meant for a speaker with a 4 ohm load into an electronic device without the same resistance. It can't handle that, and now it is toast.
The signal being "crossed over" or not has no bearing on this. The only way to remedy this is to repair or replace the board in your IJ.