that definately sucks. i've had to get a handfull of aluminum screws out of aluminum bulkheads in the past. i think the real problem here is that most alum ball ends are a 4-40 thread. i'd be willing to bet your hub thread was 3mm based on the fact that you say the ball was a tough fit. for me would just use an exacto or something to dig in and rotate it out. but mine was free to do that.
i think you may have to go in with a small drill bit. one would slide through the original threads with minimal clearance (try another hole to check this). then you may just have to re-cut the threads with a tap and use a steel or titanium ball next time.
if you need any of these parts go to
the tap is a very valuable tool to have. it will clear burrs, and it is usefull to help thread into plastic.
hope this helps. good luck.