Yeah, that and those "brushless" car washes. Necessary evil, as I see it.
What do you do to buff yours out? I have never done much beyond using a wax with a mild cleaner. One of my cars was black and that stuff always left swirls. Maybe that's just how black paint is - nearly impossible to get perfect and shows every imperfection.