Yes, the spur gear carrier is the same part for the FF-03, FF-04, and XV-01.
I strongly recommend using a slipper clutch, though. As a tuning option it's very useful in low-traction conditions. Not so much of an issue if you only run on pavement though.