Could be slop in the gears as they wear causing the servo motor to have to hunt for neutral a bit more aggressively, or there's increased friction due to wear or dirt or lack of lubricant. Or maybe the magnet has weakened over time.

You mentioned it's a brushed motor. The brushes will wear out and become less efficient.