Yep. Fail safes only work when there's electricity available. Dead batteries = no electricity.
You also should consider investing in a throttle return spring which may help when the battery dies by pulling the throttle servo into a closed position. The spring requires no electricity.