The first thing I'd do is check the oil level and make sure it is fine. When it runs dry of oil, it may stop smoking too. And replacing the broken PCV valve would be a wise thing to do as well.
When it was billowing smoke could you tell if the smoke smelled like burning oil or more like unburned fuel?
-Rod