Perd,
I have an 03 Camry LE and I do not have this noise in the rear end. You're right; your vehicle should not be doing this and I believe your dealer is wrong when it says that it's normal. It sounds like something is definitely loose back there. It's time to use your warranty!