Help needed

I have a 92 Civic CRX 5 speed Manual transmisson. My trouble is when I let off the gas pedal it makes a grinding noise and starts to free wheel. When I give it gas again it takes off and runs good until I let off the gas again. I put another tranny in from a junk yard but it still dose it. Did I get a bad tranny or is something else wrong. Thanks for any Help