just curious, but what were the plastic shims that you removed? Were they installed in the kingpins for the axle?

I would check that again and see if you can get things moving freely WITH that shim in place. maybe even use some fine grit sand paper on them before they go in.