Depends on how you are using the B4, and your personal comfort level, but many experienced racers run 2WD buggies without servo savers. A lot of B4 guys glue it together or eliminate it because of issues. The TLR 22 doesn't even have a saver.
While it can seem risky, the front of a 2WD buggy is pretty light, combined with modern stout metal geared servos it seems to work reasonably well. Can help "walk" away from a pipe if you get stuck at an angle. Be smart about it of course, if you end up jammed under a pipe with the wheels forced over hold the steering over until marshaled, etc.
But if you aren't comfortable then keep the saver setup, and check it occasionally.