You haven't "snapped" the hex all the way onto the pin. The play behind the hex to bearing should be .1-.2mm not very much at all.
If you have installed and tightened the wheels on and then remove you should see that this process will click them into place. Other wise you have to hold the driveshaft into the hub and push the hex on to snap it over the pin.
