Yep, unless you have like a helping hand or a small clamp/vise (jig) , I'd tape the connector to your workbench, then use your free hand to pull the wire as you desolder it.

If I bought a battery with many connectors, I would just remove all the connectors I don't need. GL