Is the original battery a rechargeable one? If it isn't, there's going to be a blocking diode in the circuit to prevent a non-recharageable from being charged that will need to be jumped out or replaced with a wire jumper.
You tell by measuring the + terminal with a meter when the game is on - no voltage=diode blocked. The schematics don't really call out that section it just says "B+" on the 5101 input.