Yes, this happens with the stock bladders.
The performance of the shock will degrade as well when the bladder is swollen and soft.
When you are running the stock bladders you want to change them about every month or before every big race. When you have some more experience with this you really start to notice when the bladders need replacing.
When I was still running Xray I switched to Tamiya/muchmore bladders, because these don't have this problem and have a different profile.
Xray recently released different bladders which are a bit more like the Tamiya bladders. Maybe these work a bit better then the stock bladders.
Capricorn bladders fit as well and don't have this swelling problem.