1-3am. The main thing is to be in an area away from other people & homes. That way if the cops do show up, there's a chance they'll just tell you to go home. If you're in an area where you could cause damage/injury, they won't be so nice.
I used to take my bike to Target parking lots around 2am to practice wheelies.