Thanks everyone, ran it and had no issues. Took it apart again and the play is because of the main bearing, seems as if there is a little (~1mm) axial movement. Seems normal.