You lost me at sheet of glass. Are you using a powder abrasive or something?
I found that the smoothest and longest-lasting diff I could produce was with nitride balls that I reuse, standard steel rings as opposed to lightweight ones, and a thrust bearing to hold it all together. Its expensive only once.