00 Avalon has rattle under car when I accelerate

For a few weeks I have noticed a once subtle rattle/knocking under the car when I accelerate lightly. It has gotten louder in the last few days and is constant when I accelerate slowly. If I step on the gas, it disappears...any thoughts?

A loose or damaged exhaust could cause such a noise.