This is a sensor communication issue. either your sensor wire or your motor's sensor is damaged. These symptoms you describe are because the ESC is not able to detect what position the rotor is in, so the motor "Cogs". By spinning the wheels or giving them a bump you initiate the rotation needed to defeat the lack of position information.

Start by trying a new sensor wire, if that doesn't remedy it, the motor sensor is most likely the problem.