I understand. There's a vacuum. There wasn't enough oil in the shock when you rebuilt it, so now you're getting a vacuum.
It does affect your handling, but not necessarily in a negative way. It's more important that the amount of rebound is equal between the left and right shock.
You can add more oil and re-bleed to get it to 0 or positive rebound.