Should be fine as long as you don't run them to LVC. Obviously the smaller pack will hit empty sooner. LVC is only measuring total voltage, so if one cell in the smaller pack hits empty the ESC might not pick that up depending on what LVC is set to and you'll end up with a damaged cell.