When you wiggle the connector, your ensure a good contact. When you let go, the contact is broken, so i suggest you pull the connector and inspect each contact. Ensure they are clean and serviceable (not loose). Reseat the connector (firmly) and try again. Otherwise you have a loose/broken wire somewhere near the connector.