yes the height matters, that's why you cut the arm plate also very important is to move the servo forward and back based on the caster you run.
If you look at all the different setups on petitrc, posted above you will see how they measure the distance