Brake Caliper Paint chipping

Now granted I think that the cause of this was that the primer was not dryed completely before the red paint was applied but after 1 year most of the paint has chipped off. Most of it comes off when I apply a water hose to clean the brake dust off. I'm getting ready to repaint them and heres my question-- How Do I get all the left over brake caliper paint off??
Thanks!