Of course. A battery is a battery, volts are volts.
You have two options: one 4 cell or two 2 cells.
Just don't run them down like you would a SLA or poof!
You could wire in a voltage cutoff or monitor to keep tabs on the packs and you will need a lipo capable charger.