The bearing is not falling out right? I think you mean the inner race moves when you move the crank? You should "pull" the crank all the way out, and move that inner racing all the way "back" towards the backplate as you can when you put the cone on. This way when you tighten up the flywheel it will not really move back and forth.