I had the same shit happen with my Spektrum DX3.0 this weekend. Exactly as you describe, just randomly every now and then losing control, sometimes constant. Changed the receiver, still had the same thing happen.
We raced in VERY high and strong winds this weekend though and that's the only thing different to last weekend when it was working fine...
Cheers