How many shims did you use, and does your left side bearing holder sit flush with the inside of the bulkhead or stick in a little?
I guess the issue that bothers me is that both sides are the same, and going out more is going to be running into the body.