Yeah, i think THIN CA can fix it. put plenty on, and slide the magnet on. let it cure for plenty of time, and dont use accelerant, it wont make as strong a bond.
it should hold, just try to ease into the throttle smoothly rather than slamming. it probably came off from rapid acceleration.
hope it helps! Cheers!