Brushed isn't really all that much different at least in principle. I have good quality 19T motors that are way faster than some cheap 12T motors I once bought for my little guy.

Although there are more differences today, due to increased diversity of designs and manufacturers, as Snellemin listed. Certainly understand it's confusing.