It is normal because the servo is hold its neutral point. If it did not hold neutral then it would have a slight delay when the servo horn is moved. You can shorten the life of servos by accidently leaving the switch on because of this reason. Hopes this helps.