Rear differential fluid

I just changed my rear dif. fluid. As i was taking the cover off a little dirt got inside on the gears,i wiped all that i could get to out.If there was still a little left behind will this effect my rear diffferential.

Yes. The oil is supposed to be clean and grit-free. That's usually why it has to be changed.