Now get your favorite cleaner-degreaser (I prefer simple green or 409) and spray the fret until it's saturated, then allow it 5 minutes to sit.
After letting it soak take an old SOFT toothbrush (you do keep retired ones, right?) and GENTLY scrub the fret while spraying additional cleaner as needed.
Then......................