oil leak

i've just noticed that i am leaking oil from a camshaft seal. it's a black rubber plug behind the distributer. i was thinking of just taking it out and putting some rtv and reinstall the plug. will this stop the leak?