are you using the e clips? if so remove the e cliip and re-assemble.
Not using the clips, and have assembled with different configurations of shims on the inside and outside of the axle and still have the same issue.
It is almost like the one side has the pin hole in the wrong spot