The pop you hear is the capacitor charging, if you pay very close attention you can see this too. Completely normal.
With the battery unconnected put together + and - wires to fully discharge the capacitor, put one wire on the battery and look while you put on the second wire, you will see a spark as the capacitor is drawing a very high current from the battery to charge itself.