do it now
Do it before you any commitments including a wife, kids, a mortgage, a job, etc. Just remember that if you do succeed, you will be racing toy cars for a very average living. One other thing, what you think is fun as a hobby or an activity becomes a very different thing when you have to do it for a living.
Good luck!!!