Inner Rim Grind

I'm having a problem with the rims I installed for my 96 Civic EX. I installed the used rims from a 2002-2003 Acura, stock 14". Whenever I make a sharp left-turn or a u-turn towards the left, I hear a metallic grinding noise. When I took it to the place where I had the rims installed, the inner lip of the rim (where the weights are placed) is grinding with some curved bar that is connected to the plate where the rim itself is attached. Here's a quick mockup:

http://imgur.com/8ba2k.jpg

Can I just add a spacer to fix this? It's only on the driver-side and when turning left.