Get a set of small hairbands. They are a bit fuel proof and do work perfectly.

Be sure you have a smooth servo. Some standard plastic gear servo's are hard to turn by hand so a simple spring or rubber band will not work either.