I thought that another big problem is that our suspension and steering has too much slop compared with the real thing.
On the other hand, try removing all the slop, you'll end up with an undrivable car.