Could be a grounding problem between the boards. Suggest soldering seperate
ground and 5v wires between boards and supply. Also make sure the 5v supply
is close to that value.
Sounds like your boards are working, just a poor connection between them.