I had to try and do this one day for my single cell to charge for my tm glow plug ignitor and usually just used electrical tape around the cell to hold the alligator clips on when charging but it was a pain so I made the little tray in the attachment.
As for charging 3-4 multiple cells maybe you could make a tray like I have and link each cell up.