This is the end that the ball (503215) is also the piviot point for the steering knuckle and has a shoulder on it. shimming it up will weaken that piviot point.
is the ball from the E4 longer (503129) longer? So I would not weaken that piviot point.