I dust off my metal bearings with a toothbrush before I oil, but if the bearing feels grindy or too loose/rattles after the lube, I just toss it.
The rubber sealed bearings have more friction, but they are nearly maintenance free on my on road cars that gets only indoor drive time. They usually come packed with some heavy oil/grease that last a long time.