Make sure you have your turn buckles the exact same length before you mess with the trim. If they aren't the same length, then you're just masking the problem. Once they're the same length, then adjust your trim. Also, center your servo to the best of your ability, this will also help.
TQ Racing Wire