Anyone else ever have problems with the seals on the 17011 bearing?

I popped the flywheel off my Elite 5 the other day and the front seal fell right off. Most of the rubber was gone and burned up from friction I'm guessing, the second seal was looking pretty haggard too.

From the start I noticed it didn't spin as freely as most of the 17011s I've used, but I thought that running it a little bit would free it up, but I guess not.

I'm just wondering if I should stop using a shim behind the collet and if that had anything to do with it. I've always ran it that way with my mbx7t in the past without any problems