I am pretty sure I can get away with doing one hole like that. I have a counter sink bit for my drill that I can use. I also thought about squaring off the edge of the screw that holds the mounts to the servo. This gives me another 0.5mm -ish and then I can pick up the other 0.5 mm milling down the mount and/or servo case.
thanks again for the tip.